Senior Data Engineer Data EngineerData EngineeringPythonSQLPySparkApache SparkDatabricksAWSAzureETLELTBig DataCloud DataData LakeData WarehouseData ModellingTalent Zone Consultant
We are seeking an experienced Data Engineer to join our team in Chennai. In this role, you will work with large datasets and develop systems for data storage and processing. You will be responsible for building and maintaining data pipelines that ensure data is accessible and reliable, enabling informed decision-making across the organization.Key Responsibilities:- Data Pipeline Development: Design and implement scalable data pipelines to efficiently extract, transform, and load data from various sources into databases and data warehouses.- Database Management: Manage and optimize database systems for performance and reliability, ensuring that data is stored securely and efficiently.- Collaboration with Teams: Work closely with data analysts, data scientists, and other stakeholders to understand data requirements and provide necessary data solutions.- Data Quality Assurance: Monitor data quality and integrity, performing regular checks and troubleshooting issues to ensure accuracy and reliability of data.- Documentation: Create and maintain clear documentation for data systems and processes to facilitate knowledge sharing and system maintenance.Required Skills and Expectations:The ideal candidate should have 8 to 11 years of experience in data engineering. Proficiency in SQL and experience with ETL tools are essential. Familiarity with programming languages such as Python or Java is expected. You should possess strong problem-solving skills and be able to work collaboratively in a team-oriented environment. A good understanding of data warehousing concepts and a commitment to maintaining high data quality standards are also necessary for success in this role.
Job Openings for 5 AWS Developer Jobs with minimum 8 Years Experience in Chennai, Pune, Greater Hyderabad, Delhi NCR, having Educational qualification of : Professional Degree with Good knowledge in AWS, ETL Consultant, ETL Tool etc.
Requirements:1. Proficient in design and development of data pipelines/integration jobs.2. Experience in Azure data factory/aws Glue/Talend/SSIS/informatica power centre.3. Experience in python data transformation with S3/BLOB,etc.4. Experience in constructing logical and physical data modelling to build the data warehouse/data lake.5 Experience in ETL methodology for performing Data Profiling, Data migration, extraction, transformation and loading using ETL tools.