Data Engineer Job Vacancies in Pune

As a Data Engineer, your responsibilities will include collecting and analyzing data to help inform business decisions. You will be responsible for data management, ensuring that data is accurate and up-to-date. This will involve using tools such as Informatica, PLSQL, SQL, and Oracle SQL to manipulate and query large datasets.Your skills should include a strong understanding of data analysis techniques, such as data mining and statistical analysis.

We are seeking a talented AI/ML Engineer to design, develop, and deploy machine learning models that solve real-world business problems.Key ResponsibilitiesDevelop, train, and optimize machine learning and deep learning models.Design and implement AI solutions for automation, prediction, and data analysis.Work with large datasets to clean, preprocess, and engineer features.Deploy models into production environments and monitor performance.Build scalable ML pipelines and integrate models with applications.Conduct experiments, model evaluations, and performance tuning.Collaborate with cross-functional teams including data engineers and product managers.Stay updated with the latest research and advancements in AI/ML.Note: Only Pune-based candidates can eligible to apply.

About Netra LabsAt Netra Labs, we redefine enterprise AI with our groundbreaking platform, Ground Truth. Our platform transforms expertise into powerful AI agents, enabling businesses to automate complex tasks efficiently. With a user-friendly interface and seamless integration with any language model, Ground Truth empowers system integrators, innovators, and developers to rapidly build and deploy AI solutions. Our commitment to security, scalability, and ROI ensures our clients can trust us with their AI-driven workflows.Role OverviewWe are looking for a highly skilled Python Engineer to lead our backend team and drive the development of scalable, secure, and high-performance AI-powered applications. The ideal candidate will have expertise in data science, a deep understanding of backend development, and hands-on experience with cloud services and DevOps practices. You will work closely with cross-functional teams, ensuring seamless integration between AI models, data pipelines, and enterprise applications.Key Responsibilities Work with the backend development team, ensuring best practices in coding, architecture, and performance optimization. Design, develop, and maintain scalable backend services using Python and FastAPI. Architect and optimize databases, ensuring efficient storage and retrieval of data using MongoDB. Integrate AI models and data science workflows into enterprise applications. Implement and manage AWS cloud services, including Lambda, S3, EC2, and other AWS components. Automate deployment pipelines using Jenkins and CI/CD best practices. Ensure security and reliability, implementing best practices for authentication, authorization, and data privacy. Monitor and troubleshoot system performance, optimizing infrastructure and codebase. Collaborate with data scientists, front-end engineers, and product team to build AI-driven solutions. Stay up to date with the latest technologies in AI, backend development, and cloud computing.Required Skills & Qualifications 3+ years of experience in backend development with Python. Strong experience in FastAPI or other modern Python web frameworks. Proficiency in MongoDB or other NoSQL databases. Hands-on experience with AWS services (Lambda, S3, EC2, etc.). Experience with GitHub Actions and CI/CD pipelines. Data Science knowledge with experience integrating AI models and data pipelines. Strong understanding of RESTful API design, microservices, and event-driven architecture. Experience in performance tuning, caching, and security best practices. Proficiency in working with Docker and containerized applications. Excellent problem-solving skills and ability to lead a team. Strong communication skills to interact with stakeholders and cross-functional teams.Preferred Qualifications Experience with Machine Learning frameworks such as TensorFlow or PyTorch. Knowledge of GraphQL, WebSockets, or gRPC. Familiarity with Terraform or Kubernetes for infrastructure as code. Experience with big data processing frameworks such as Apache Spark.

Requirements:8+ years of experience in Core Java and Spring Framework (Mandatory)Minimum 2 years of experience in Google Cloud Platform (GCP) (Mandatory)Hands-on experience with Apache Beam / Dataflow for building ETL/data pipelines (Mandatory)Strong expertise in big data processing on distributed systemsProficiency with RDBMS, NoSQL, and Cloud-native databasesExperience in handling multiple data formats (Flat file, JSON, Avro, XML, etc.) with schema/contract definitionsExperience in Microservices architecture and API integration patternsStrong understanding of data structures and data model design

3+ years of AWS data engineering: Glue, Step Functions, Lambda, S3, DynamoDB, EC2Strong Python (boto3) scripting for automationTerraform or CloudFormation expertiseHands-on experience integrating RAG workflows or deploying LLM applicationsSolid SQL and NoSQL data-modeling skillsExcellent written and verbal communication in client-facing contexts

supervision site survey team mobilisation work track daily report

Sr. Big Data Engineer Location: PuneExperience: 10+ years Mode: HybridRole Overview:We are seeking a talented Sr. Big Data Engineer to design, develop, and support a highly scalable, distributed SaaS-based Security Risk Prioritization product. You will lead the design and evolution of our data platform and pipelines, providing technical leadership to a team of engineers and architects.Key Responsibilities: Provide technical leadership on data platform design, roadmaps, and architecture. Design and implement scalable architecture for Big Data and Microservices environments. Drive technology explorations, leveraging knowledge of internal and industry prior art. Ensure quality architecture and design of systems, focusing on performance, scalability, and security. Mentor and provide technical guidance to other engineers.Required Skills & Technologies: Mandatory: Kafka, Scala, Spark. Big Data & Data Streaming: Spark, Kafka, Hadoop, Presto, Airflow, Data lakes, lambda architecture, kappa, and kappa ++ architectures with flink data streaming. Databases & Caching: RDBMS, NoSQL, Oracle, Cassandra, Redis. Search Solutions: Solr, Elastic. ML & Automation: Experience with ML models engineering and related deployment, scripting, and automation. Architecture: In-depth experience with messaging queues and caching components. Other Skills: Strong troubleshooting and performance benchmarking skills for Big Data technologies.Qualifications: Bachelors degree in Computer Science or equivalent. 8+ years of total experience, with 6+ years relevant. 2+ years in designing Big Data solutions with Spark. 3+ years with Kafka and performance testing for large infrastructure.

Need a employee

Responsibilities: Design, develop, and deploy data solutions on Azure, leveraging SQL Azure,Azure Data Factory, and Databricks. Build and maintain scalable data pipelines to ingest, transform, and load datafrom various sources into Azure data repositories. Implement data security and compliance measures to safeguard sensitiveinformation. Collaborate with data scientists and analysts to support their data requirementsand enable advanced analytics and machine learning initiatives. Optimize and tune data workflows for performance and efficiency. Troubleshoot data-related issues and provide timely resolution. Stay updated with the latest Azure data services and technologies andrecommend best practices for data engineering.Qualifications: Bachelors degree in computer science, Information Technology, or related field. Proven experience as a data engineer, preferably in a cloud environment. Strong proficiency in SQL Azure for database design, querying, and optimization. Hands-on experience with Azure Data Factory for ETL/ELT workflows. Familiarity with Azure Databricks for big data processing and analytics. Experience with other Azure data services such as Azure Synapse Analytics,Azure Cosmos DB, and Azure Data Lake Storage is a plus. Solid understanding of data warehousing concepts, data modeling, anddimensional modeling. Excellent problem-solving and communication skills.

Role: Bigdata Developer - Scala SparkExp: 5+ YrsMode of Work: WFO All 5 daysLocation: Chennai/Bangalore/PuneInterview: Any one Level F2FJob Description: Total IT / development experience of 3+ years Experience in Spark (Scala-Spark ) developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB Deep knowledge of Scala-Spark libraries to develop and debug complex data engineering challenges Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies Exposure to deploying on Cloud platforms At least 2 years of development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark-Scala At least 2 years of development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS At least 2 years of developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, Unix Shell Scripting, TDD, CI/CD, Change Management to support DevOps

We are looking for 5 BIM ENGINEER/ COORDINATOR Posts in Pune, with deep knowledge in creating digital simulations of the onsite workflow, verifying that information entered into the BIM is correct, creating and maintaining the project's overall BIM execution plan, ensuring it remains up to date throughout the course of the project, training team members on how to use BIM software, verifying that exported data from the BIM is accurate and complete, configuring 3D models using BIM-specific modelling programs such as Revit, participating in meetings with project teams to ensure everyone understands how to adhere to the BIM process, participating in meetings with clients and stakeholders as a BIM expert, organising agendas for regular coordination meetings and updates, transferring information and data to updated software versions and Required Educational Qualification is : Diploma, B.Arch, B.E, B.Tech, M.Arch, M.Tech

Work Mode: Hybrid6-9 years of overall IT experience, preferably in cloud environments.Minimum of 5 years of hands-on experience with AWS cloud development projects.Design and develop AWS data architectures and solutions.Build robust data pipelines and ETL processes using big data technologies.Utilize AWS data services such as Glue, Lambda, Redshift, and Athena effectively.Implement infrastructure as code (IaC) using Terraform.Proficiency in SQL, Python, and other relevant programming/scripting languages.Experience with orchestration tools like Apache Airflow or AWS Step Functions.Strong understanding of data warehousing concepts, data lakes, and data governance frameworks.Expertise in data modeling for both relational and non-relational databases.Excellent communication skills are essential for this role.

Level of skills and experience:5 years of hands-on experience in using Python, Spark,Sql.Experienced in AWS Cloud usage and management.Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow).Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch.Experience with orchestrators such as Airflow and Kubeflow.Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).Fundamental understanding of Parquet, Delta Lake and other data file formats.Proficiency on an IaC tool such as Terraform, CDK or Cloud Formation.Strong written and verbal English communication skill and proficient in communication with non-technical stakeholderst

Strong experience with Microsoft Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure SQL Database.Proficiency in ETL processes, data pipeline design, and automation within the Azure ecosystem.Experience with big data technologies such as Apache Spark, Hadoop, Azure HDInsight, and Databricks.Solid understanding of data modeling, data warehousing concepts, and relational and non-relational databases.Strong knowledge of SQL and experience with scripting languages like Python, R, or Scala.Experience with Azure Storage services, such as Blob Storage, Data Lake Storage, and Azure Cosmos DB.Familiarity with Data Governance, Data Lineage, and Data Security practices in the cloud.Hands-on experience with Azure DevOps for CI/CD pipeline management, version control, and deployment automation.Familiarity with Azure Active Directory (AAD) and role-based access control (RBAC) for managing permissions and security.Experience with RESTful APIs and integrating with third-party systems for data ingestion and export.Strong problem-solving and analytical skills, with the ability to work with large datasets and derive actionable insights.Ability to collaborate effectively with stakeholders and communicate complex data engineering concepts in simple terms.Preferred Qualifications:Azure certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect Expert.Experience with real-time data processing using Azure Stream Analytics or Apache Kafka.Knowledge of machine learning and AI concepts for data-driven decision-making.Familiarity with Power BI or other reporting tools for data visualization.Experience with Agile methodologies in a data engineering environment.

Detailed Job Description:We are looking for an Ataccama Admin to join our team and help us manage and maintain our Ataccama data quality and data governance platform. You will be responsible for installing, configuring, and maintaining Ataccama on AWS/Azure platform, as well as developing and implementing data quality rules and policies. You should have a deep understanding of Ataccama architecture and best practices, as well as experience in data management and data governance. Experience in administering Collibra and Immuta is preferred. You should also have experience in managing VMs and Windows and Linux based systems. Pharma experience is preferred.Essential Duties and Responsibilities: Install, configure, and maintain Ataccama Develop and implement data quality rules and policies Monitor and report on data quality metrics Troubleshoot and resolve Ataccama-related issues Stay up-to-date on the latest Ataccama features and best practices Work with cross-functional teams to implement data governance policies and procedures Manage and maintain VMs and Windows and Linux based systems Manage redundancy, backup and recovery plans and processes Strong AWS/Azure experienceQualifications: 4+ years of experience with Ataccama Experience in data management and data governance Experience in administering Collibra and Immuta is preferred Experience in managing VMs and Windows and Linux based systems Experience in Performance Tuning Pharma experience is preferred Strong analytical and problem-solving skills Excellent communication and teamwork skills

Responsibilities: Design, develop, and maintain scalable data pipelines using modern data engineering tools and technologies. Extract, transform, and load (ETL) data from various sources (e.g., databases, APIs, cloud storage) into data warehouses or data lakes. Understand data requirements from business team and ensure data quality and consistency. Optimize data pipelines for performance and efficiency. Optimize data infrastructure for ML model training and deployment. Explore and experiment with new data engineering techniques and technologies. Qualifications: Bachelors degree in Computer Science, Data Science, or a related field. 1-2 years of hands-on experience in data engineering or a similar role. Strong proficiency in Python and common data engineering tools (e.g., Apache Spark, Hadoop, Airflow). Knowledge of SQL and experience working with relational and NoSQL databases. Understanding of data warehousing and data lake concepts. Familiarity with AI/ML and LLM workflows and data requirements. Excellent problem-solving, analytical, and communication skills. Passion for data engineering and a desire to contribute to AI/ML projects. Experience with cloud platforms (e.g., AWS, GCP, Azure) and cloud-based data engineering services is big plus. Knowledge of data visualization tools (e.g., Tableau, Power BI). Experience with machine learning frameworks (e.g., TensorFlow, PyTorch). Familiarity with LLM architectures and applications.

We have vacant of 61 Software Engineer Jobs in Gauriganj, Amethi,Musafirkhana Amethi,Shahada, Nandurbar,bhetuaa,Babarpur Ajitmal Auraiya,Hasanpur, Samastipur,Tingre Nagar, Pune,Sorab, Shimoga,koodheeyara,Mandir Hasaud, Raipur, for Freshers Educational Qualification : Higher Secondary, Secondary School, Diploma, B.A, B.Arch, B.C.A, B.B.A, B.Com, B.Ed, B.Sc Skill Cost Management,Calling,Customer Handling,Data Engineer etc.

Role Summery you will be responsible for Analysing archiving and reporting requirements, source and destination systems and their data models and designing data transformation, archiving, reporting and analytics solutions that meet the functional and non-functional requirements. You will work closely with Project Managers to deliver the program. Dimension of Function Data Analysis, Data Modelling, Designing Data Solutions.Area of Responsibility Experienced Solutions Architect / Data Engineer with track record of creating large data tech solutions. Excellent understanding of the data tech solutions, specially Google Cloud. Data transformation and scripting experience. Sufficient programming knowledge to manage developer projects; for example, Python, JavaScript, SQL, etc. Working understanding of SQL Server 2008 & 2012. Developing software solutions. Familiar with industry data visualisation solutions.Knowledge / Experience Ability to present complex propositions in a simple manner. Able to articulate big ideas in plain language. Management of tech partners and experience at managing outsourcing / insourcing process. Experience working with internal/external dev teams and associated ways of working. Experience with multiple methodologies. Awareness of project management principles and experience of working with internal and external teams across multiple locations. Working knowledge of statistical techniques and predictive analytics also desirable. Excellent numerical and analytical skills Experience of statistical methodologies and data analysis techniques Ability to produce clear graphical representations and data visualisations. Knowledge of data analysis tools, for example, R Programming, Tableau Public, SAS, Apache Spark, Excel, RapidMiner Knowledge of data modelling, data cleansing, and data enrichment techniques An understanding of data protection issues Experience of working with Cloud based Data Analytics

Work mode : Hybrid Overall 4-9 yrs of IT experience preferably in cloudMin 3 years in Azure Databricks on development projectsShould be 100% hands on in Pyspark codingShould have strong SQL expertise in writing advanced/complex SQL queriesDWH experience is a must for this roleExperience in programming using Python is an advantageExperience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirementsShould be able to understand system architecture which involves Data Lakes, Data Warehouses and Data MartsExperience to own end-to-end development, including coding, testing, debugging and deploymentExcellent communication is required for this role

Dear Candidate ,Give dynamic start to your career with VMS Group SECRET TECHNOLOGIES INDIA , we are looking for freshers and experienced candidates who want to make good career in IT or NON It field.Job Type: Full time.Eligibility criteria : Fresher /Experience 0-5 Year.Location : Pune. OR PAN INDIADesired Qualification - Any Bachelor degree Minimum BA ,B.Com - Commerce, B.E , B.Tech, M.Sc , M.C.A B.C.A ,Any Graduates, Post Graduates, can also apply. Should be comfortable to work any location of pune or Pan India.Your application for theTesting & DevelopmentBack Office / Data EntryTechnical Support, Non-Voice ProcessBDE (canadian, US, UK)-In HouseBusiness Development Executive, On FieldOperations/Customer Service , Customer Service (Web)BPO MNC and Domestic ( Hindi Marathi or Any local language)Accounts & Finance /Financial AnalystPosition stood out to us and we would like to invite you for a Face to face interview Telephone interview at our office to get to know you a bit better.You will meet with the MR. Prem Sir or Aishwarya Ma'am.The interview will last about 20 minutes and you'll have the chance to discuss the above position and learn more about our company. Please carry your updated resume at list Two CopiesDesired Candidate - Candidate should be Dynamic, Enterprising, Presentable with excellent communication and written skills.If candidate is interested please visit our office. Monday to Saturday 10 am to 5 pm bitwin anytime Meet- Prem Sir / Ms. Aishwarya Ma'am Interview Venue-building A -15th , city vista, foundation road, Kharadi, Pune, Maharashtra 411014We will take 2 rounds of an interview.-Contact No. 7066165593 Aishwarya Ma'am 7066147637 Prem Sir 1. HR Round and simple logic checking P.I round.2. Technical HR Final round by Senior HR Manager.Thanks & Regards SECRET TECHNOLOGIES INDIA VMS GROUP Placement / Contract Labour / Real EstateAddress -building A -15th , city vista, foundation road, Kharadi, Pune, Mahara