69

Data Engineer Job Vacancies in Chennai

filter
  • Location
  • Role
  • Functional Area
  • Qualification
  • Experience
  • Employer Type
  • Fresher
  • 4.0 Lac/Yr
  • Central Railway Station Chennai
Data Management Data Processing Data Sheets Data Migration Data Analysis Data Modeling ETL Tools ETL Processes Data Visualization Data Warehousing
We are looking for a Data Processing Engineer to join our team. This is a part-time position.
View all details
  • 0 - 2 yrs
  • 5.0 Lac/Yr
  • Chennai
Data Management Data Extraction Data Entry Data Validation
We are looking for a Data Engineer to join our team in Chennai. This part-time role allows you to work from home and is suitable for candidates with 0 to 2 years of experience. **Key Responsibilities:**- **Data Collection:** Gather data from various sources to ensure we have accurate and relevant information for analysis. This includes pulling data from databases, APIs, and other data repositories.- **Data Cleaning:** Improve data quality by identifying errors and inconsistencies. This means ensuring that all data is accurate, complete, and usable for analysis.- **Data Storage:** Help design and manage data storage solutions, ensuring that data is stored securely and can be accessed efficiently by team members.- **Data Transformation:** Convert raw data into a usable format for analysis. This involves using tools and programming languages to modify and structure data appropriately.- **Collaboration:** Work with data scientists and analysts to understand their data needs. This role requires communicating effectively with team members to support their projects.**Required Skills and Expectations:**- Basic understanding of data engineering concepts and tools, such as SQL, Python, or similar programming languages.- Strong attention to detail, as accuracy in data handling is crucial.- Ability to work independently and manage your time effectively while meeting deadlines.- Good communication skills to share ideas and collaborate with others in the team. - A curious mindset and willingness to learn about new technologies and data processes.
View all details

Gen AI Developer (5+ Yrs Exp)

Turn5tech HR Solution

  • 5 - 9 yrs
  • Guindy Chennai
Azure Developer Gen AI Developer Python Developer Data Engineer
We are looking for a Gen AI Developer with 5 to 9 years of experience to join our team in Guindy. The successful candidate will work on developing innovative artificial intelligence solutions.**Key Responsibilities:**- **AI Model Development:** Create and implement machine learning models to solve complex problems, ensuring they meet performance expectations.- **Data Analysis:** Analyze large datasets to extract meaningful insights and improve AI functionalities, enhancing the effectiveness of AI solutions.- **Collaboration with Teams:** Work closely with cross-functional teams, including data scientists and software developers, to integrate AI capabilities into existing systems and products.- **Testing and Optimization:** Conduct thorough testing of AI models and applications, optimizing them for better performance and user experience.- **Continuous Learning:** Stay updated with the latest trends and advancements in AI technology, and apply new knowledge to improve current practices.**Required Skills and Expectations:**- Candidate should hold a Bachelors degree in Computer Applications (B.C.A), Bachelor of Science (B.Sc), or Bachelor of Engineering (B.E).- A strong understanding of machine learning algorithms, natural language processing, and deep learning frameworks is essential.- Proficiency in programming languages such as Python, R, or Java is required to develop and implement AI models.- Excellent problem-solving skills and the ability to work independently as well as part of a team are necessary.- Strong communication skills to effectively collaborate with team members and stakeholders are important for success in this role.Work Location: Chennai Guindy Tamil Nadu 626001Interested For Job Please Call Immediately & Share you updated profileCall/Whatsapp: Mr. Pradeep HR careerturn5techhrsolution@gmail.com
View all details
  • Fresher
  • Female
  • Chennai
Data Cleansing Big Data Technologies Data Transformation Programming Data Warehousing
We are seeking a motivated and enthusiastic Data Processing Engineer to join our team. This role is perfect for recent graduates or individuals looking to start their career in data processing.As a Data Processing Engineer, you will be responsible for handling and organizing data efficiently. Your key responsibilities will include:- **Data Entry**: Accurately input data into our systems while ensuring all information is correct and up to date.- **Data Quality Assurance**: Review and validate data to identify any errors or inconsistencies, and fix them promptly.- **Data Maintenance**: Regularly update and maintain databases to keep them organized and accessible for team members.- **Reporting**: Generate basic reports from the data you process, helping the team make informed decisions.To be successful in this role, you should possess strong attention to detail and the ability to work independently from home. You must be comfortable using computers and familiar with basic data processing tools. Strong communication skills are essential to collaborate effectively with team members. Having a proactive approach to problem-solving will also be important as you work through data challenges.We welcome applications from females who have completed their 10th grade education and are eager to begin a full-time position in data processing. This is a fantastic opportunity to learn, grow, and launch your career in the field of data.
View all details

Get Personalized Job Matches

Based on your experience, skills, interests, and career goals to help you find the most relevant opportunities faster. Register Now!

Looking For Lead Process Engineer

Cynosure Corporate Solutions

  • 7 - 10 yrs
  • Chennai
DMAIC Statistical Analysis SPC FMEA Process Improvement Process Mining Power BI PythonMinitab Time Series Forecasting Capacity Planning GenAIAI Tools Data Modeling Stakeholder Management
We are looking for a highly analytical Lead Process Engineer to drive operational excellence and process transformation within lending operations. The role involves leveraging advanced statistical methods, process intelligence, and AI-assisted tools to improve efficiency, reduce variation, and enable scalable business operations. This position also includes mentoring junior team members while collaborating with cross-functional stakeholders.Key Responsibilities:Lead end-to-end process improvement initiatives using DMAIC methodologyApply statistical analysis, DoE, and SPC techniques to enhance process performanceDesign and optimize operational workflows across lending value streamsBuild and maintain process intelligence dashboards for real-time insightsConduct FMEA-based risk assessments and implement mitigation strategiesDrive AI-assisted process improvements using GenAI tools and automation frameworksPerform capacity forecasting and time series modeling for scaling operationsCollaborate with Product, Data, and Operations teams for transformation initiativesPresent ROI-driven insights and business cases to senior stakeholdersMentor and develop Process Analysts and Junior EngineersRequired Skills & Qualifications:7-9 years of experience in process engineering, quality engineering, or operations improvementStrong expertise in Lean Six Sigma methodologies (DMAIC execution experience mandatory)Hands-on experience in statistical tools: DoE, SPC, regression, hypothesis testingExperience with process mining / intelligence tools (Power BI, Celonis, etc.)Proven experience in FMEA and risk assessment frameworksStrong capability in capacity planning and time series forecastingExposure to AI/GenAI tools in operational environmentsProficiency in Excel (advanced), Python or Minitab, and data visualization toolsStrong stakeholder management and communication skills
View all details
  • 5 - 7 yrs
  • 12.0 Lac/Yr
  • Chennai
Snow Flake Developer Dbt Dagster SQL Python Git Cicd Pipelines Data Modeling Datawarehouse Architecture Claude Copilot Data Extraction
We are looking for Senior Data Engineer (Snowflake / dbt / Dagster / AI-Assisted Development) with 5+ Year Experience in Chennai.Design and optimize data pipelines from SQL Server to Snowflake Work with healthcare data formats including EDI 835 / 837 if applicable Use AI tools (LLMs, code assistants, automation agents) to improve engineeringproductivity and quality
View all details

Looking For Data Engineer

BSRI Solutions Pvt Ltd

  • 3 - 5 yrs
  • 16.0 Lac/Yr
  • Chennai
Python Pyspark Developer Scala SQL Hive Hadoop Google Cloud Platform Kafka Developer Infrastructure AS Code GitHub Agile Methodology ETL
Required Qualifications : 3+ years of demonstrated ability with Hive, Python, Spark/Scala, SQL, etc. Google Cloud Platform Experience, Big Query, Cloud Storage, Dataproc, Data Flow, Cloud Composer, Cloud SQL, Pub Sub, Terraform, etc. Experience with Hadoop Ecosystem, Kafka, PCF cloud services Familiar with big data and machine learning tools and platforms Experience with BI tools, such as Alteryx, Data Stage, QlikSense, etc. Design data pipelines and data robots, take a vision and bring it to life Master data engineer; mentors others; works closely with IT architects to set strategy and design projects Provide extensive technical, and strategic advice and guidance to key stakeholders around the data transformation efforts Redesign data flows to prevent recurring data issues Strong analytical and problem-solving skills Possess excellent oral and written communication skills, as well as facilitationand presentation skills, and engaging presentation style. Ability to work as a global team member, as well as independently, in achanging environment and prioritize. Ability to establish and maintain coordinated and effective working relationships with application implementation teams, IT project teams, business customers, and end users. Ability to deliver work within deadlines. Experience with agile/lean methodologies Experience working independently and with minimal supervision Experience with Test Driven Development and Software Craftsmanship Experience with GitHub, Accurev, or other version-control systems Experience with Putty Experience with Datastage Strong Communications skills Ability to illustrate and convey ideas and prototypes effectively with team and partners Presence demonstrating confidence, ability to learn quickly, influence, and shape ideas Key Skills Required - Data Engineer- Python / PySpark / Scala- SQL & Hive- Hadoop Ecosystem- Data Pipeline Design & ETL Development- Google Cloud Platform (BigQuery, Dataproc, Dataflow, Cloud Storage)- Kafka / Streaming Data Processing- Terraform (Infrastructure as Code)- DataStage or Similar ETL Tools- Version Control (GitHub or equivalent)- Agile Methodologies- Strong Analytical & Problem-Solving Skills- Stakeholder Collaboration & CommunicationNice to Have:- Cloud Composer, Cloud SQL, Pub/Sub- BI Tools (Alteryx, QlikSense)- Machine Learning Platform Exposure- Test Driven Development (TDD)- Mentoring & Technical Leadership
View all details
Software Engineer Information Technology Engineer Java Html Autocad Data Analyst Web Tools System Support Engineer Banking Back Office Back End Processing Admin Freshers Airport Operation Airport Executive Airport Representative Airline Ground Staff
The Information Technology Engineer is responsible for designing, developing and implementing software applications and systems to support the organization's operations. They will also provide technical support and assistance to end-users.Key responsibilities include:- Developing and maintaining software applications using various programming languages such as Java, Html, and Autocad- Conducting data analysis to identify trends and patterns- Providing system support and troubleshooting technical issues- Working closely with the team to implement and maintain web tools
View all details

Big Data Engineer (Spark and Scala)

E2E Infoware Management Services

Scala Spark Pyspark
Role: Bigdata Developer - Scala SparkExp: 5+ YrsMode of Work: WFO All 5 daysLocation: Chennai/Bangalore/PuneInterview: Any one Level F2FJob Description: Total IT / development experience of 3+ years Experience in Spark (Scala-Spark ) developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB Deep knowledge of Scala-Spark libraries to develop and debug complex data engineering challenges Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies Exposure to deploying on Cloud platforms At least 2 years of development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark-Scala At least 2 years of development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS At least 2 years of developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, Unix Shell Scripting, TDD, CI/CD, Change Management to support DevOps
View all details

Hiring Program Support For Chennai

ConnectM Technology Solutions

  • 1 - 3 yrs
  • Chennai
Requirement Gathering Data Analysis Solution Design Documentation Stakeholder Management Software Project Management Engineering Change Management Subject Matter Expert
Position Overview: The Program support plays a critical role in driving the success of an organization by analyzing business processes, identifying improvement opportunities, and providing valuable insights for decision-making. The role involves gathering and documenting requirements, conducting data analysis, and facilitating communication between stakeholders to ensure successful project delivery.Key Responsibilities:1. Requirements Gathering: Collaborate with stakeholders to identify and document business needs, objectives, and requirements. Conduct interviews, workshops, and analysis of existing systems and processes to elicit comprehensive requirements.2. Data Analysis: Analyze large datasets to identify trends, patterns, and insights. Utilize statistical techniques and data visualization tools to present findings and support decision-making processes.3. Process Improvement: Identify opportunities to enhance operational efficiency and effectiveness through process analysis and optimization. Recommend and implement process improvements to achieve business goals and objectives.4. Solution Design: Collaborate with cross-functional teams to translate business requirements into functional specifications. Work closely with software development teams to ensure the development of high-quality solutions that meet business needs.5. Documentation: Create and maintain clear and concise documentation, including business requirements, functional specifications, process flows, and user manuals. Ensure documentation is up to date and readily available for reference.6. Stakeholder Management: Engage with stakeholders at various levels to understand their needs, address concerns, and provide regular updates on project progress. Facilitate effective communication and collaboration between business units and technical teams.7. Project Management Support: Assist in project planning, scheduling, and monitoring activities. Contribute to project status reporting and risk management activities to ensure timely and successful project delivery.8. Change Management: Support change management initiatives by identifying potential risks and impacts of proposed changes. Develop and execute change management plans to ensure smooth transitions and user adoption.9. Training and Support: Provide training and support to end-users on new systems, processes, and functionalities. Act as a subject matter expert and provide guidance to business users as needed.Qualifications: Diploma/ Bachelor's degree in Mechanical/ Electrical. Experience in automotive background is must with 2-5 yrs exp. Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information. Solid understanding of business processes and the ability to identify areas for improvement. Excellent communication skills, both verbal and written, with the ability to convey complex information to non-technical stakeholders. Strong interpersonal skills and the ability to build relationships with stakeholders at all levels of the organization. Detail-oriented with strong organizational and time management skills. Familiarity with project management methodologies and tools.
View all details

Hiring For Data Engineer

International Recruiters

DataPipelines Etlprocesses Etldeveloper BusinessIntelligence Business Intelligence Tool Data Integration BI Analyst Business Intelligence Analyst SQL SQL Developer Data Engineer Python For ETL API Development Data Scripting Dataware Housing Azure Administrator Ssis Developer Azure Data Engineering
Location: Guindy, Chennai, Tamil Nadu, IndiaExperience: 36 yearsReports To: BI ManagerJob Type: Full-timeKey Responsibilities Build and maintain scalable data pipelines and ETL processes for BI needs. Optimize data models and ensure clean, reliable, and well-structured data for Power BI. Integrate data from various internal systems (web apps, databases, accounting platforms). Collaborate with BI analysts and managers to meet reporting requirements. Automate data refreshes and performance-tune dashboards. Maintain metadata, data dictionaries, and lineage documentation.Required Skills Strong SQL development and performance tuning skills. Hands-on experience with Power BI dataset structuring and integration. Familiarity with Python for ETL, automation, or data cleaning tasks. Knowledge of APIs and scripting for data ingestion. Understanding of data warehousing and modelling techniques (star/snowflake schemas). Experience working with Azure, SSIS, or any cloud-based data services is a plus. Familiarity with version control systems like Git
View all details

AWS Data Engineer

Hexaware Technologies

SQL AWS Python ETL TERRAFORM LAMDA
Work Mode: Hybrid6-9 years of overall IT experience, preferably in cloud environments.Minimum of 5 years of hands-on experience with AWS cloud development projects.Design and develop AWS data architectures and solutions.Build robust data pipelines and ETL processes using big data technologies.Utilize AWS data services such as Glue, Lambda, Redshift, and Athena effectively.Implement infrastructure as code (IaC) using Terraform.Proficiency in SQL, Python, and other relevant programming/scripting languages.Experience with orchestration tools like Apache Airflow or AWS Step Functions.Strong understanding of data warehousing concepts, data lakes, and data governance frameworks.Expertise in data modeling for both relational and non-relational databases.Excellent communication skills are essential for this role.
View all details
Python SQL ML Docker AWS Cloud Engineer
Level of skills and experience:5 years of hands-on experience in using Python, Spark,Sql.Experienced in AWS Cloud usage and management.Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow).Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch.Experience with orchestrators such as Airflow and Kubeflow.Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).Fundamental understanding of Parquet, Delta Lake and other data file formats.Proficiency on an IaC tool such as Terraform, CDK or Cloud Formation.Strong written and verbal English communication skill and proficient in communication with non-technical stakeholderst
View all details

Looking For Hiring For BMS Commissioning Engineer

JOB24by7 Recruitment Consultancy Services

Electrical Electronics Instrumentation BMS Engineering Testing Commissioning SCADA PLC OPC Designing Building Management System Automation HMI Programming Graphics SQL Computer Knowledge Data Base Database Management Programming Problem Solving Troubleshooting Skills Technical Skills Client Coordination Client Management Implementation Communication Organizational
Bachelors degree in Electrical/Electronics/Instrumentation Engineering Degree from an accredited college or university.Minimum 3 years of experience in BMS Engineering, Testing & CommissioningSCADA, PLC, BMS engineering/programming experience preferred.Strong understanding of OPC, BACnet, Modbus protocol to include IP, ETH and MS/TPDesign, development, commissioning, and testing of Building automation systemsBMS/SCADA/HMI graphic screen developmentIO Loop test and Functional testBasic knowledge on SQL database programming.Excellent problem-solving and troubleshooting skillsProviding technical support to clientsExperience with current trends in automation and instrumentation to be able to select and implement modern controls architecturesStrong communication and organizational skills
View all details
Production Planning Material Requirement Planning Enterprise Resource Planning Lean Six Sigma Capacity Planning Auto CAD Engineer Data Analysis Bottleneck Identification Quality Control Communication & Coordination Decision-Making Time Management Leadership & Teamwork
he PPC Engineer is responsible for planning, scheduling, and monitoring production activities to ensure efficient manufacturing processes. They coordinate with various departments, manage inventory, optimize resource utilization, and ensure timely delivery of products while maintaining quality standards.
View all details

ML Engineer

Thirumoolar IT Solutions

  • 0 - 1 yrs
  • Chennai
Data Analysis Machine Learning AI Engineer
Welcome to Thirumoolar IT Solutions Free Internship Program 2025Duration : One MonthWorkplace: Work From HomeLaptop: Self/Own Laptop or 25k refundable deposit for company laptopIntern Administrative Cost: (Rs.1000 (Registration fee)+180 (18%GST) = Rs.1180Internship Domain: Machine LearningBenefits For Interns1. All interns will be provided with A+ Class training2. Intern completion certificate3. Intern ID card4. Company T-shirtImportant NoteAfter completion of the internship, the candidate will be observed in our company for direct hiring based on their performance at the time of internship
View all details

SAP Role

Rigel Networks

SAP BTP Integration Suite SAP APO +GATP SAP APO +TVPS SAP SF + VP SAP SF + CDP SAP CPI With PI PO SAP PM With MRS SAP SF With RCM and OBM Senior Data Engineer Data Engineer Lead SAP CPI Consultant SAP CAP Consultant SAP UI5 Consultant
SkillSAP BTP Integration SuiteSAP APO +GATPSAP APO +TVPSSAP SF + VPSAP SF + CDPSAP CPI with PI/POSAP PM With MRSSAP SF With RCM and OBMSenior Data EngineerData Engineer LeadSAP CPI consultantSAP CAP consultantSAP UI5 consultantSAP ABAP+HANA consultant
View all details
Cloud Engineer
Strong experience with Microsoft Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure SQL Database.Proficiency in ETL processes, data pipeline design, and automation within the Azure ecosystem.Experience with big data technologies such as Apache Spark, Hadoop, Azure HDInsight, and Databricks.Solid understanding of data modeling, data warehousing concepts, and relational and non-relational databases.Strong knowledge of SQL and experience with scripting languages like Python, R, or Scala.Experience with Azure Storage services, such as Blob Storage, Data Lake Storage, and Azure Cosmos DB.Familiarity with Data Governance, Data Lineage, and Data Security practices in the cloud.Hands-on experience with Azure DevOps for CI/CD pipeline management, version control, and deployment automation.Familiarity with Azure Active Directory (AAD) and role-based access control (RBAC) for managing permissions and security.Experience with RESTful APIs and integrating with third-party systems for data ingestion and export.Strong problem-solving and analytical skills, with the ability to work with large datasets and derive actionable insights.Ability to collaborate effectively with stakeholders and communicate complex data engineering concepts in simple terms.Preferred Qualifications:Azure certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect Expert.Experience with real-time data processing using Azure Stream Analytics or Apache Kafka.Knowledge of machine learning and AI concepts for data-driven decision-making.Familiarity with Power BI or other reporting tools for data visualization.Experience with Agile methodologies in a data engineering environment.
View all details

Data Engineer

Particleblack

  • 8 - 10 yrs
  • Chennai
Python SQL
Estimating and Planning, Work breakdown for the team. Data pipelines,PR & Code Reviews, Performance & Load Testing, Functional & Regression Testing, Tier 2 support/consulting, Production Support, Functional ask to Technical design. Data Engineering, Agile Methodologies.Place : ChennaiExperience : 8+ YearsNo of openings : 1Skills : Python, Complex SQL, ETL,Azure DevOps
View all details

Ataccama Admin

Learning Lane Pvt Ltd

Ataccama Devops Engineer AWS Azure Administrator Linux Windows Vms-virtual Memory System Data Management
Detailed Job Description:We are looking for an Ataccama Admin to join our team and help us manage and maintain our Ataccama data quality and data governance platform. You will be responsible for installing, configuring, and maintaining Ataccama on AWS/Azure platform, as well as developing and implementing data quality rules and policies. You should have a deep understanding of Ataccama architecture and best practices, as well as experience in data management and data governance. Experience in administering Collibra and Immuta is preferred. You should also have experience in managing VMs and Windows and Linux based systems. Pharma experience is preferred.Essential Duties and Responsibilities: Install, configure, and maintain Ataccama Develop and implement data quality rules and policies Monitor and report on data quality metrics Troubleshoot and resolve Ataccama-related issues Stay up-to-date on the latest Ataccama features and best practices Work with cross-functional teams to implement data governance policies and procedures Manage and maintain VMs and Windows and Linux based systems Manage redundancy, backup and recovery plans and processes Strong AWS/Azure experienceQualifications: 4+ years of experience with Ataccama Experience in data management and data governance Experience in administering Collibra and Immuta is preferred Experience in managing VMs and Windows and Linux based systems Experience in Performance Tuning Pharma experience is preferred Strong analytical and problem-solving skills Excellent communication and teamwork skills
View all details

Data Engineer

United Technology

  • 1 - 3 yrs
  • 4.0 Lac/Yr
  • Chennai
Data Integration Data Engineer Hadoop ETL SQL Informatica Apache AWS Big Data Python
We are looking Data Engineer with 1 to 3 years experience in Chennai.Immediate joiners preferred
View all details
  • 4 yrs
  • 15.0 Lac/Yr
  • Tharamani Chennai
Machine Learning Large Language Models LLM Evaluation LLM Optimization Clustering Customer Segmentation SQL Python Data Pipeline Development ML Algorithms Airflow
Role OverviewWe are seeking a highly skilled Machine Learning Engineer with 4+ years of experience to bridge the gap between Generative AI and actionable business intelligence. The ideal candidate will be responsible for optimizing Large Language Model (LLM) performance and developing advanced clustering models for customer and product segmentation.Location : Shollinganallur , ChennaiKey ResponsibilitiesLLM Optimization & EvaluationOptimize accuracy and reduce latency of LLM-powered applicationsDesign and implement robust LLM evaluation frameworksWork with LLM APIs and integrate them into production workflowsAdvanced Analytics & ModelingDevelop clustering models for customer and product segmentationIncorporate complex business logic into ML modelsApply statistical and machine learning techniques to derive actionable insightsData Engineering & OrchestrationBuild and maintain scalable data pipelines using SQLDevelop and manage Python-based DAGs (e.g., Airflow)Ensure efficient data processing and workflow automationTechnical RequirementsMandatory SkillsStrong experience in LLM EvaluationHands-on expertise in Clustering TechniquesAdvanced proficiency in SQLExperience building Python-based DAGs (Airflow or similar tools)Experience working with LLM APIsPreferred (Bonus) SkillsExperience in self-hosting and fine-tuning LLMsKnowledge of Time Series ForecastingExperience in Dimension Reduction techniquesFamiliarity with Market Basket AnalysisHands-on experience with Spark and Alteryx
View all details

Looking For Senior Data Engineer

BSRI Solutions Pvt Ltd

  • 5 - 9 yrs
  • 30.0 Lac/Yr
  • Chennai
Databricks Pyspark Java Web Services SQL Python
Job Title: Senior Data Engineer Experience: 5+ YearsLocation: Chennai (Hybrid)Budget: Up to 30 LPAJob SummaryWe are looking for a highly skilled developer with strong hands-on experience in Databricks, PySpark, Python/Java, Web Services, and SQL. The ideal candidate will work closely with architects, tech leads, and business teams to design, build, optimize, and support scalable data-driven solutions. This is a long-term role with a strong focus on performance, cost optimization, and production support.Key Responsibilities / Essential Job FunctionsUnderstand end-to-end system architecture and support operations through monitoring and dashboardsCollaborate with Architects and Tech Leads on solution design and implementationContinuously monitor and optimize system cost and performanceWork closely with Business Analysts on integration requirementsCoordinate with TCOE teams for defining test scenarios and supporting testing activitiesTroubleshoot performance and functional issues across environmentsDocument key technical decisions and maintain detailed design documentationHandle fast-paced project deliveries and support production issues as requiredQuickly learn and adapt to new technologies and frameworksEnsure prompt and effective communication with stakeholdersOther ResponsibilitiesCreate, document, and maintain project artifactsFollow industry standards, methodologies, and best practicesSafeguard company assets and sensitive information (PI)Report any suspected security or compliance issues promptlyAdhere to company compliance and governance policiesMaintain focus on customer service, efficiency, quality, and business growthCollaborate effectively with cross-functional teamsPerform other duties as assignedMinimum Qualifications & Job RequirementsMinimum 5+ years of IT development experienceStrong analytical and problem-solving skillsProven experience in solution design, code reviews, and mentoring junior engineersStrong backend development experience on data-driven projectsExcellent SQL and database skillsStrong team player with good communication skillsMandatory Technical SkillsPython / PySparkSQL / PL-SQLDatabricksJava or C#Preferred / Good-to-Have SkillsAzure CloudKafkaNode.jsAzure Data Factory
View all details
  • 3 - 9 yrs
  • 18.0 Lac/Yr
  • Chennai
Automation Testing DBT Test Pytest SQL Validators Complex SQL Agile Ceremonies Relational Databases ETLELT Workflows Data Pipelines Testing Airflow DAG Executions Selenium Cucumber Playwright JIRA Data Validation ISTQB Python
Role: Quality Assurance Engineer (Data & API)SUMMARYThe Quality Assurance Engineer partners with Engineering, Data, and Developmentteams to ensure client requirements are implemented correctly and reliably acrosshighvolume data pipelines. This role reviews requirements, designs test strategies, andexecutes automated and manual validation-emphasizing shiftleft practices andrepeatable automation. Candidates are former developers or Software DevelopmentEngineer in Test (SDET) who can effectively test large datasets, craft complex SQL fordata comparisons, and collaborate within a single, shared sprint cadence.ESSENTIAL DUTIES AND RESPONSIBILITIES Configure, implement, and maintain automated testing frameworks for data and APIvalidation (DBT tests, Pytest, SQL validators). Translate JIRA user stories and acceptance criteria into comprehensive test plans,scenarios, and data validation scripts. Ensure requirements traceability by mapping test cases and validation scriptsdirectly to client requirements and acceptance criteria, maintaining cleardocumentation throughout the lifecycle. Design and execute unit, integration, smoke, regression, and endtoend tests alignedto the recommended QA & automation framework. Validate large datasets for completeness, accuracy, timeliness, lineage, and schemaconformance, author complex SQL for data comparison. Coordinate with Engineering to enable shiftleft testing - QA participates ingrooming, planning, and daily standups; quality is a shared responsibility. Assist with user acceptance testing (UAT) and production validation, includingpostrelease smoke testing and regression cycles. Analyze test outputs, identify defects, document issues, and drive rootcauseanalysis; champion environment parity (VAL mirrors PROD). Contribute to release governance: freeze windows, QA gates, rollback plans, andrelease logs; ensure test evidence is captured. Continuously improve tools, templates, and processes; propose JIRA automation toautocreate QA stories from engineering stories. Develop domain knowledge of client data products, pipelines, integrations, and KPIs. Maintain comprehensive test documentation, including test cases, scripts, andresults, to support audits and compliance. Conduct performance and security testing as required to ensure robust, scalable,and secure solutions. Advocate for user experience and usability in all testing activities.AGILE & COLLABORATION EXPECTATIONS Active participant in Agile ceremonies (grooming, planning, standups, demos, retros)within a single, shared sprint cadence. Story readiness includes defined test criteria and data availability; QA estimatestracked alongside development. Promote predictable velocity by integrating automated tests into CI; definition ofdone includes -tested and validated.- Stay current with emerging QA tools, technologies, and best practices; proactivelyrecommend improvements to processes and frameworks.REQUIRED QUALIFICATIONS Former software developer or SDET with handson coding experience (Pythonpreferred). Expertise in SQL and relational databases; able to design complex validationqueries for large datasets. Demonstrated experience testing data pipelines, ETL/ELT workflows, and APIs inhighvolume environments. Practical knowledge of Airflow (or similar orchestration), DBT, and CI systems;experience validating DAG executions. Proficiency with automated testing tools (Selenium/Cucumber/Playwright for UIwhere applicable; Pytest for services; DBT for data). Proficiency with version control systems (e.g., Git) and defect tracking tools (e.g.,Jira, Azure DevOps). Experience with JIRA and Agile development methodology; comfortable with sharedsprint delivery. Strong critical thinking; challenges ambiguous requirements and drives clarity inacceptance criteria. Excellent communication skills; able to partner with Product Owners and Engineersto define testable stories.PREFERRED / DOMAIN EXPERIENCE Experience with liveevent data, broadcast schedules, media assets, or fanengagement platforms. Experience with bigdata validation (Snowflake/BigQuery/Redshift) and performancetesting of queries at scale. Familiarity with API contract testing, data lineage tools, and dataset comparisonframeworks. ISTQB or equivalent certification is a plus. Experience with cloud-based data platforms (AWS, Azure, GCP) is a plus.
View all details

Looking For Azure Data Engineer

Hexaware Technologies

Azure Date Engineer Pyspark SQL Data Warehouse Data Lakes
Work mode : Hybrid Overall 4-9 yrs of IT experience preferably in cloudMin 3 years in Azure Databricks on development projectsShould be 100% hands on in Pyspark codingShould have strong SQL expertise in writing advanced/complex SQL queriesDWH experience is a must for this roleExperience in programming using Python is an advantageExperience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirementsShould be able to understand system architecture which involves Data Lakes, Data Warehouses and Data MartsExperience to own end-to-end development, including coding, testing, debugging and deploymentExcellent communication is required for this role
View all details

Data Modeler

Particleblack

  • 5 - 7 yrs
  • Chennai
SQL Data Engineer Data Modeler
Atleast 2 Projects done as Data Modeler.Discover, analyze, and scope data requirements ; create high level process models to represent processes for the area under analysis.Create detailed mapping documents covering source to target mapping, transformation logic and harmonization. Design Data Architecture, Strategy, Employ Entity-Relationship modeling with the intent of producing a design best suited for retrospective analysis of data.Healthcare Domain Knowledge is a must; Exposure to HL7, FHIR, OMOP will be a plusSkills : SQL, IBM UDMH Model - Atomic or Dimensional Model, IDA, ERWin, ER-Studio, Data normalization and denormalization techniques.
View all details

Data Architect

Particleblack

  • 8 - 10 yrs
  • Chennai
Data Engineer Python Warehouse
Cloud Data Engineering + Cloud Data Architecture + Data Integration Data Architecture Expertise:Lead the design and implementation of robust, scalable and secure data platform architecture Solution Design Expertise: Serve as a trusted advisor to our data architecture, data engineering teams, providing guidance on cloud architecture design, implementation strategies and best practices.GCP Expertise:Demonstrate proficiency in GCP tools and services, including BigQuery, CloudSpanner, Dataflow, DataForm, Dataprep, and Healthcare APIs. Stay abreast of GCP updates and incorporate new features into our architecture.Place : ChennaiExperience : 8+ YearsNo of openings : 2Skills : Data Integration, warehouse implementations , ETL/ELT Tools, Python, Data normalization and denormalization techniques.
View all details

Python Architect (12-19 Years)

Cynosure Corporate Solutions

  • 12 - 19 yrs
  • Chennai
Python Architecture Advanced Python Development System Design Microservices Data Engineering AIML Platforms API Design Performance Optimization Code Governance
We are looking for a highly experienced Python Architect to design and lead large-scale, enterprise-grade Python solutions for AI, data, and analytics platforms. The role requires deep hands-on expertise in Python across architecture, development, and production systems, supporting end-to-end AI and data-driven solutions.Key Responsibilities:Architect scalable, high-performance systems using Python as the core technologyDefine technical architecture for AI, data engineering, and analytics platformsLead design and development of microservices, APIs, and backend frameworks in PythonEnsure production-ready implementations with strong focus on performance, security, and reliabilityCollaborate with data science, ML, DevOps, and product teams to operationalize AI solutionsEstablish coding standards, best practices, and architectural guidelinesReview code, mentor senior engineers, and provide technical leadershipDrive innovation and continuous improvement in Python-based system designRequired Skills & Qualifications:1218 years of experience working fully and extensively in PythonStrong expertise in Python system architecture and large-scale backend designExperience supporting AI/ML, data engineering, or analytics platformsSolid understanding of microservices, REST APIs, and distributed systemsHands-on experience with cloud platforms (AWS/Azure/GCP)Strong problem-solving skills and ability to lead complex technical initiativesExcellent communication and stakeholder collaboration skills
View all details

Looking For Data Engineer

Cynosure Corporate Solutions

  • 8 - 14 yrs
  • Chennai
Data Engineer Python AWS
Responsibilities: Designing and implementing data pipelines to collect, clean, and transform data from various sources Building and maintaining data storage and processing systems, such as databases, data warehouses, and data lakes Ensuring data is properly secured and protected Developing and implementing data governance policies and proceduresCollaborating with business analysts, data analysts, data scientists, and other stakeholders to understand their data needs and ensure they have access to the data they need Sharing knowledge with the wider business, working with other BAs and technology teams to make sure processes and ways of working is documented. Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems. Ensure the design, code and procedural aspects of solution are production ready, in terms of operational, security and compliance standards. Participate in day-to-day project and agile meetings and provide technical support for faster resolution of issues. Clearly and concisely communicating to the business, on status of items and blockers. Have an end-to-end knowledge of the data landscape within the company. Skills & Experience: 10+ years of design & development experience with big data technologies like Azure, AWS or GCP Preferred is Azure & Databricks, with experience in Azure DevOps Experience in data visualising technology in DL, like PowerBI Proficient in Python, PySpark and SQL Proficient in querying and manipulating data from various DB (relational and big data). Experience of writing effective and maintainable unit and integration tests for ingestion pipelines. Experience of using static analysis and code quality tools and building CI/CD pipelines. Excellent communication, problem-solving, and leadership skills, and be able to work well in a fast-paced, dynamic environment.
View all details
View More Jobs

Apply to 69 Data Engineer Job Vacancies in Chennai

  • Chennai Jobs
  • Hyderabad Jobs
  • Ahmedabad Jobs
  • Bangalore Jobs
  • Mumbai Jobs
  • Pune Jobs
  • Kolkata Jobs
  • Delhi Jobs