Data Engineer Graduate Jobs in Pune

We are seeking a talented AI/ML Engineer to design, develop, and deploy machine learning models that solve real-world business problems.Key ResponsibilitiesDevelop, train, and optimize machine learning and deep learning models.Design and implement AI solutions for automation, prediction, and data analysis.Work with large datasets to clean, preprocess, and engineer features.Deploy models into production environments and monitor performance.Build scalable ML pipelines and integrate models with applications.Conduct experiments, model evaluations, and performance tuning.Collaborate with cross-functional teams including data engineers and product managers.Stay updated with the latest research and advancements in AI/ML.Note: Only Pune-based candidates can eligible to apply.

About Netra LabsAt Netra Labs, we redefine enterprise AI with our groundbreaking platform, Ground Truth. Our platform transforms expertise into powerful AI agents, enabling businesses to automate complex tasks efficiently. With a user-friendly interface and seamless integration with any language model, Ground Truth empowers system integrators, innovators, and developers to rapidly build and deploy AI solutions. Our commitment to security, scalability, and ROI ensures our clients can trust us with their AI-driven workflows.Role OverviewWe are looking for a highly skilled Python Engineer to lead our backend team and drive the development of scalable, secure, and high-performance AI-powered applications. The ideal candidate will have expertise in data science, a deep understanding of backend development, and hands-on experience with cloud services and DevOps practices. You will work closely with cross-functional teams, ensuring seamless integration between AI models, data pipelines, and enterprise applications.Key Responsibilities Work with the backend development team, ensuring best practices in coding, architecture, and performance optimization. Design, develop, and maintain scalable backend services using Python and FastAPI. Architect and optimize databases, ensuring efficient storage and retrieval of data using MongoDB. Integrate AI models and data science workflows into enterprise applications. Implement and manage AWS cloud services, including Lambda, S3, EC2, and other AWS components. Automate deployment pipelines using Jenkins and CI/CD best practices. Ensure security and reliability, implementing best practices for authentication, authorization, and data privacy. Monitor and troubleshoot system performance, optimizing infrastructure and codebase. Collaborate with data scientists, front-end engineers, and product team to build AI-driven solutions. Stay up to date with the latest technologies in AI, backend development, and cloud computing.Required Skills & Qualifications 3+ years of experience in backend development with Python. Strong experience in FastAPI or other modern Python web frameworks. Proficiency in MongoDB or other NoSQL databases. Hands-on experience with AWS services (Lambda, S3, EC2, etc.). Experience with GitHub Actions and CI/CD pipelines. Data Science knowledge with experience integrating AI models and data pipelines. Strong understanding of RESTful API design, microservices, and event-driven architecture. Experience in performance tuning, caching, and security best practices. Proficiency in working with Docker and containerized applications. Excellent problem-solving skills and ability to lead a team. Strong communication skills to interact with stakeholders and cross-functional teams.Preferred Qualifications Experience with Machine Learning frameworks such as TensorFlow or PyTorch. Knowledge of GraphQL, WebSockets, or gRPC. Familiarity with Terraform or Kubernetes for infrastructure as code. Experience with big data processing frameworks such as Apache Spark.

Requirements:8+ years of experience in Core Java and Spring Framework (Mandatory)Minimum 2 years of experience in Google Cloud Platform (GCP) (Mandatory)Hands-on experience with Apache Beam / Dataflow for building ETL/data pipelines (Mandatory)Strong expertise in big data processing on distributed systemsProficiency with RDBMS, NoSQL, and Cloud-native databasesExperience in handling multiple data formats (Flat file, JSON, Avro, XML, etc.) with schema/contract definitionsExperience in Microservices architecture and API integration patternsStrong understanding of data structures and data model design

3+ years of AWS data engineering: Glue, Step Functions, Lambda, S3, DynamoDB, EC2Strong Python (boto3) scripting for automationTerraform or CloudFormation expertiseHands-on experience integrating RAG workflows or deploying LLM applicationsSolid SQL and NoSQL data-modeling skillsExcellent written and verbal communication in client-facing contexts

supervision site survey team mobilisation work track daily report

Sr. Big Data Engineer Location: PuneExperience: 10+ years Mode: HybridRole Overview:We are seeking a talented Sr. Big Data Engineer to design, develop, and support a highly scalable, distributed SaaS-based Security Risk Prioritization product. You will lead the design and evolution of our data platform and pipelines, providing technical leadership to a team of engineers and architects.Key Responsibilities: Provide technical leadership on data platform design, roadmaps, and architecture. Design and implement scalable architecture for Big Data and Microservices environments. Drive technology explorations, leveraging knowledge of internal and industry prior art. Ensure quality architecture and design of systems, focusing on performance, scalability, and security. Mentor and provide technical guidance to other engineers.Required Skills & Technologies: Mandatory: Kafka, Scala, Spark. Big Data & Data Streaming: Spark, Kafka, Hadoop, Presto, Airflow, Data lakes, lambda architecture, kappa, and kappa ++ architectures with flink data streaming. Databases & Caching: RDBMS, NoSQL, Oracle, Cassandra, Redis. Search Solutions: Solr, Elastic. ML & Automation: Experience with ML models engineering and related deployment, scripting, and automation. Architecture: In-depth experience with messaging queues and caching components. Other Skills: Strong troubleshooting and performance benchmarking skills for Big Data technologies.Qualifications: Bachelors degree in Computer Science or equivalent. 8+ years of total experience, with 6+ years relevant. 2+ years in designing Big Data solutions with Spark. 3+ years with Kafka and performance testing for large infrastructure.

Responsibilities: Design, develop, and deploy data solutions on Azure, leveraging SQL Azure,Azure Data Factory, and Databricks. Build and maintain scalable data pipelines to ingest, transform, and load datafrom various sources into Azure data repositories. Implement data security and compliance measures to safeguard sensitiveinformation. Collaborate with data scientists and analysts to support their data requirementsand enable advanced analytics and machine learning initiatives. Optimize and tune data workflows for performance and efficiency. Troubleshoot data-related issues and provide timely resolution. Stay updated with the latest Azure data services and technologies andrecommend best practices for data engineering.Qualifications: Bachelors degree in computer science, Information Technology, or related field. Proven experience as a data engineer, preferably in a cloud environment. Strong proficiency in SQL Azure for database design, querying, and optimization. Hands-on experience with Azure Data Factory for ETL/ELT workflows. Familiarity with Azure Databricks for big data processing and analytics. Experience with other Azure data services such as Azure Synapse Analytics,Azure Cosmos DB, and Azure Data Lake Storage is a plus. Solid understanding of data warehousing concepts, data modeling, anddimensional modeling. Excellent problem-solving and communication skills.

Role: Bigdata Developer - Scala SparkExp: 5+ YrsMode of Work: WFO All 5 daysLocation: Chennai/Bangalore/PuneInterview: Any one Level F2FJob Description: Total IT / development experience of 3+ years Experience in Spark (Scala-Spark ) developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB Deep knowledge of Scala-Spark libraries to develop and debug complex data engineering challenges Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies Exposure to deploying on Cloud platforms At least 2 years of development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark-Scala At least 2 years of development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS At least 2 years of developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, Unix Shell Scripting, TDD, CI/CD, Change Management to support DevOps

Level of skills and experience:5 years of hands-on experience in using Python, Spark,Sql.Experienced in AWS Cloud usage and management.Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow).Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch.Experience with orchestrators such as Airflow and Kubeflow.Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).Fundamental understanding of Parquet, Delta Lake and other data file formats.Proficiency on an IaC tool such as Terraform, CDK or Cloud Formation.Strong written and verbal English communication skill and proficient in communication with non-technical stakeholderst

Strong experience with Microsoft Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure SQL Database.Proficiency in ETL processes, data pipeline design, and automation within the Azure ecosystem.Experience with big data technologies such as Apache Spark, Hadoop, Azure HDInsight, and Databricks.Solid understanding of data modeling, data warehousing concepts, and relational and non-relational databases.Strong knowledge of SQL and experience with scripting languages like Python, R, or Scala.Experience with Azure Storage services, such as Blob Storage, Data Lake Storage, and Azure Cosmos DB.Familiarity with Data Governance, Data Lineage, and Data Security practices in the cloud.Hands-on experience with Azure DevOps for CI/CD pipeline management, version control, and deployment automation.Familiarity with Azure Active Directory (AAD) and role-based access control (RBAC) for managing permissions and security.Experience with RESTful APIs and integrating with third-party systems for data ingestion and export.Strong problem-solving and analytical skills, with the ability to work with large datasets and derive actionable insights.Ability to collaborate effectively with stakeholders and communicate complex data engineering concepts in simple terms.Preferred Qualifications:Azure certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect Expert.Experience with real-time data processing using Azure Stream Analytics or Apache Kafka.Knowledge of machine learning and AI concepts for data-driven decision-making.Familiarity with Power BI or other reporting tools for data visualization.Experience with Agile methodologies in a data engineering environment.

Detailed Job Description:We are looking for an Ataccama Admin to join our team and help us manage and maintain our Ataccama data quality and data governance platform. You will be responsible for installing, configuring, and maintaining Ataccama on AWS/Azure platform, as well as developing and implementing data quality rules and policies. You should have a deep understanding of Ataccama architecture and best practices, as well as experience in data management and data governance. Experience in administering Collibra and Immuta is preferred. You should also have experience in managing VMs and Windows and Linux based systems. Pharma experience is preferred.Essential Duties and Responsibilities: Install, configure, and maintain Ataccama Develop and implement data quality rules and policies Monitor and report on data quality metrics Troubleshoot and resolve Ataccama-related issues Stay up-to-date on the latest Ataccama features and best practices Work with cross-functional teams to implement data governance policies and procedures Manage and maintain VMs and Windows and Linux based systems Manage redundancy, backup and recovery plans and processes Strong AWS/Azure experienceQualifications: 4+ years of experience with Ataccama Experience in data management and data governance Experience in administering Collibra and Immuta is preferred Experience in managing VMs and Windows and Linux based systems Experience in Performance Tuning Pharma experience is preferred Strong analytical and problem-solving skills Excellent communication and teamwork skills

Responsibilities: Design, develop, and maintain scalable data pipelines using modern data engineering tools and technologies. Extract, transform, and load (ETL) data from various sources (e.g., databases, APIs, cloud storage) into data warehouses or data lakes. Understand data requirements from business team and ensure data quality and consistency. Optimize data pipelines for performance and efficiency. Optimize data infrastructure for ML model training and deployment. Explore and experiment with new data engineering techniques and technologies. Qualifications: Bachelors degree in Computer Science, Data Science, or a related field. 1-2 years of hands-on experience in data engineering or a similar role. Strong proficiency in Python and common data engineering tools (e.g., Apache Spark, Hadoop, Airflow). Knowledge of SQL and experience working with relational and NoSQL databases. Understanding of data warehousing and data lake concepts. Familiarity with AI/ML and LLM workflows and data requirements. Excellent problem-solving, analytical, and communication skills. Passion for data engineering and a desire to contribute to AI/ML projects. Experience with cloud platforms (e.g., AWS, GCP, Azure) and cloud-based data engineering services is big plus. Knowledge of data visualization tools (e.g., Tableau, Power BI). Experience with machine learning frameworks (e.g., TensorFlow, PyTorch). Familiarity with LLM architectures and applications.

We have vacant of 61 Software Engineer Jobs in Gauriganj, Amethi,Musafirkhana Amethi,Shahada, Nandurbar,bhetuaa,Babarpur Ajitmal Auraiya,Hasanpur, Samastipur,Tingre Nagar, Pune,Sorab, Shimoga,koodheeyara,Mandir Hasaud, Raipur, for Freshers Educational Qualification : Higher Secondary, Secondary School, Diploma, B.A, B.Arch, B.C.A, B.B.A, B.Com, B.Ed, B.Sc Skill Cost Management,Calling,Customer Handling,Data Engineer etc.

Role Summery you will be responsible for Analysing archiving and reporting requirements, source and destination systems and their data models and designing data transformation, archiving, reporting and analytics solutions that meet the functional and non-functional requirements. You will work closely with Project Managers to deliver the program. Dimension of Function Data Analysis, Data Modelling, Designing Data Solutions.Area of Responsibility Experienced Solutions Architect / Data Engineer with track record of creating large data tech solutions. Excellent understanding of the data tech solutions, specially Google Cloud. Data transformation and scripting experience. Sufficient programming knowledge to manage developer projects; for example, Python, JavaScript, SQL, etc. Working understanding of SQL Server 2008 & 2012. Developing software solutions. Familiar with industry data visualisation solutions.Knowledge / Experience Ability to present complex propositions in a simple manner. Able to articulate big ideas in plain language. Management of tech partners and experience at managing outsourcing / insourcing process. Experience working with internal/external dev teams and associated ways of working. Experience with multiple methodologies. Awareness of project management principles and experience of working with internal and external teams across multiple locations. Working knowledge of statistical techniques and predictive analytics also desirable. Excellent numerical and analytical skills Experience of statistical methodologies and data analysis techniques Ability to produce clear graphical representations and data visualisations. Knowledge of data analysis tools, for example, R Programming, Tableau Public, SAS, Apache Spark, Excel, RapidMiner Knowledge of data modelling, data cleansing, and data enrichment techniques An understanding of data protection issues Experience of working with Cloud based Data Analytics

Description:We are looking for a competent and motivated individual to fill this role. This is an operational MSSQL DataEngineering role. Some of the primary responsibilities of this role would include development, setup a new clientfrom scratch, owning, tracking, and resolving database related incidents and requests, fulfilling requests, andresolving incidents.Responsibilities: Read business requirements - and be able to ask questions to understand the requirements. Understand information model and database schemas and plan data/table layouts and schemas. Able to write and understand SQL code (SQL-Server) for high-speed data loading pipeline. Should have good hands-on Database objects like Tables, View, Stored Procedure, Functions etc. Understand SQL Server Performance issues, find root cause and solve the problem to ensure appropriateperformance. Maintain and improve existing processes. Able to mentor junior/entry level colleagues. Should be a team player and self-driven.Skills and Qualifications: Bachelors or masters in computer science, information technology or related field, or equivalent experience Demonstrated ability to solve problems. Ability to work in a team environment. Strong verbal and written communication Positive can-do attitude Preferred Skills 4-7 years of relevant work experience

Dear Candidate,Greeting for the day!We are Hiring for the jobs for the position of Air hostess.SKILLS*Strong verbal communication skills*Excellent PersonalityInterview Timings:- 10 am to 6 pmQualification: Any Under Grad/Graduated(Freshers)POSITION:- Air Ticketing / Ground Staff / Cabin Crew / Technical DepSALARY:- 25K TO 40K + CAB + MEALSIndustry:-Aviation / AirlineLocation:-All IndiaThanksRegards/Aviation Team

Experience: 5-8 Years in IT industry.Skill Set: Experience in GCP data analytics services such as dataflow, data fusion, big query and data storage.Responsibility: Responsible for developing Enterprise Knowledge Graph (EKG) to connects all data relevant from the data sources.Unit test and validate the graph lineage.

Job Description:Significant experience in the delivery of large and complex data solutions in complex hierarchical organizations.Knowledge of event driven workflows, serialization formats, data modelling and architecting for performance.Demonstrated experience working within Business Intelligence, Data Ware house and other reporting applications.Knowledge of industry trends and technological developments in data technology and data platform design including but not limited to artificial intelligence, data process automation and big data.Advanced skills in SQL and experience using the following programming languages; Python, Scala or Java.Good knowledge of modern data architectures, including cloud native technologies.Experience using DevOps and DataOps methodologies.Proven experience in data processing frameworks such as Apache Spark and data integration tools.Demonstrated evidence of being self-motivated, results orientated and driven to improve business processes.

Looking For Immediate Joiner for a Product based US MNC company for theRole - Data EngineerLocation - Balewadi, Pune (Hybrid)Required Skills - Python/Pyspark coding , Data Factory, Data BricksMin Exp - 5 YearsTechnical Requirements- Must be hands-on/well-verses in Python/PySpark coding and scripting- Strong expertise and hands-on experience with Azure Data Factory and Azure Databricks- Experience with Agile Methodology and Azure Devops- Databricks Lakehouse architecture experience strongly preferred- Programming/Coding Skills with familiarity with software andsystem engineering design principles & standards (e.g., TDD)- Foundational knowledge of data management architectures likeData Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management- Ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, data quality and observability, schemas, metadata, and job management- Understanding of structured, semi-structured, and unstructured data sources- Experience with data integration technologies such as ETL/ELT, data replications/CDC, message-oriented data movement, API design and access, stream data integration, and data virtualization- Basic understanding of machine learning algorithms andapproaches- Knowledge of/proficiency using one or more popular languagesand frameworks such as SQL, Python, Scala, Spark, CommandLine, etc.- Familiarity with Open-Source and Commercial (e.g., Azure CloudServices) technology- Ability to automate development via CICD patterns andprocesses- Experience leveraging version control and repositorymanagement systems (Git experience recommended)- Experience leveraging IDE and source code editors (e.g., VisualStudio Code)- Data visualization (e.g., Power BI, Tableau, QlikSense)

Job PurposePlan, schedule, coordinate & execute testing activitiesResponsible for testing of systems to ensure delivery of Quality assured applications to production.Support Test Lead/ Test Manager in upward stakeholder management and day-to-day management of the QA & Test organizationJob ResponsibilitiesAssist with the planning and execution of Testing for a Project or BAU streamDevelop Test Plans, Status Reporting, Test Readiness Reviews and Test Completion Report as appropriateWork closely with off-shore team and on-shore team(s) to deliver projects to time, cost and quality requirements.Create data, conduct tests and analyze results to ensure that software meets or exceeds specified standards and /or customer requirements.Ensure that tests are successfully completed and documented and all problems are resolvedManage Risks and Issues associated with Testing engagementsQualificationsMinimum of 10 years of Testing experienceMust have strong analytical skills, reporting and problem solving skillsExcellent verbal and written communication skills(Must) Experience in Business intelligence and Data warehouse testing preferably in Hadoop Data Hub environment(Must) Expert in writing SQL queries and testing data flow across the data layers(Must) Expert in testing data quality, data integrity, data reconciliation and reporting solutions(Must) Good understanding on Data warehouse data models and creating test scenarios and cases(Preferred) Insurance (preferably general insurance) industry and product knowledge(Preferred) Experience in working with Agile teams(Preferred) Experience in DWH test automation with relevant tools.