Versatile

Kanyakumari, Tamil Nadu

Job descriptionJob Overview: We are seeking a Lead Data Engineer (AWS) with 5-6 / 5+ years of experience in AWS Cloud platform, ETL development, and data processing tools. This role involves monitoring and supporting application workflows, ensuring system connectivity and performance. The ideal candidate should have hands-on experience with in depth knowledge on AWS services, AWS Glue, Redshift, Airflow, and other data processing tools such as Spark, with the ability to guide and mentor a team in a collaborative environment. This role requires leading a team to uphold operational standards hence the candidate should have experience handling a team. CTC / Budget allocated for (Lead-Data Engineer): 11-12 LPA (for deserving candidates)Primary Responsibilities:Application Monitoring & Workflow Management: Oversee job monitoring, application flow, and system connectivity to ensure smooth operations.Utilizing AWS Glue and Redshift for data processingCandidate should possess strong knowledge in AWS Glue, Redshift, and Airflow processes and should be able to resolve bottlenecks or issues.Retrigger failed jobs and manage job orchestration through Airflow for timely task completion.Cloud Monitoring & Notifications:Utilize AWS CloudWatch to monitor system health, performance, and job status.Setup AWS Push Notifications to alert the team to system issues, such as database downtime or performance degradation.