Lead Data Engineer - Full Time

  • icon job experience 7 - 13 Years
  • icon job opening 11 Openings
  • icon salary Not Disclosed
  • icon job posting Posted today
  • Telephonic interview Telephonic interview
  • icon job location Chennai
Key Skills

GCP Google Dataflow Apache Beam Java BigQuery ETLELT Batch Processing Streaming Data Pipelines SQL Data Modeling PubSub Cloud Composer Cloud Storage Dataproc Kafka CICD Git Agile Python Spark Data Quality Data Governance Cloud Security Performance Optimization

Job Description

We are looking for a highly skilled Senior Data Engineer with strong expertise in Google Cloud Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and cloud-based data processing solutions for enterprise applications.

Key Responsibilities

Design and develop scalable ETL/ELT pipelines using GCP services.

Build and maintain real-time and batch data processing pipelines using Dataflow and Apache Beam.

Develop robust backend processing solutions using Java.

Work extensively with BigQuery for data warehousing, analytics, and performance optimization.

Integrate data from multiple sources including APIs, databases, and streaming platforms.

Optimize pipeline performance, cost, scalability, and reliability on GCP.

Collaborate with cross-functional teams including Architects, Analysts, DevOps, and Business stakeholders.

Ensure data quality, governance, monitoring, and security best practices.

Troubleshoot production issues and provide long-term scalable solutions.

Required Skills

Strong hands-on experience with GCP services.

Expertise in Google Dataflow / Apache Beam.

Strong programming skills in Java.

Hands-on experience with BigQuery.

Experience in building batch and streaming data pipelines.

Good knowledge of SQL and data modeling concepts.

Experience with CI/CD, Git, and Agile methodologies.

Strong problem-solving and debugging skills.

Good to Have

Experience with Pub/Sub, Cloud Composer, Cloud Storage, Dataproc, or Kafka.

Exposure to Python or Spark.

Experience in handling large-scale enterprise data platforms.

Preferred Qualifications

Bachelor’s/Master’s degree in Computer Science, Engineering, or related field.

GCP certifications are an added advantage.
  • Experience

    7 - 13 Years

  • No. of Openings

    11

  • Education

    Graduate

  • Role

    Lead Data Engineer

  • Industry Type

    IT & Software Development

  • Gender

    [ Male / Female ]

  • Job Country

    India

  • Type of Job

    Full Time

  • Work Location Type

    Work from Office

About Cynosure Corporate Solutions

Cynosure Corporate Solutions is a name that has been winning the trust of clients for years through its organized operations. We are providing recruitment and consulting services under one roof. Ours is a Chennai (Tamil Nadu, India) based human resource management company, specialized in providing services of a placement agency including HR consultant, training services, domestic placement and recruitment consultant. In addition to this, we provide career consultancy to candidates and services for work at home. Also, we render solutions for human capital management through a scientific approach. Owing to our well-organized database of the technical & non-technical job-openings and job-seekers, we help organizations in finding suitable talent.
Read More...
Similar Jobs
Apply Now

Register to Get Relevant Jobs