ETL Developer Graduate Experience Jobs in Pune

We are Looking for Software Engineers Freshers and Experience

We are looking for a highly skilled AWS Glue Developer with a minimum of 5-10 years of experience in the industry to join our team at IBM India. The ideal candidate will be responsible for developing and maintaining data integration solutions using AWS Glue, building ETL pipelines, and working on data lakes.Responsibilities:Develop and maintain ETL pipelines using AWS Glue.Design and develop data integration solutions using AWS Glue.Develop and maintain data ingestion, transformation, and integration solutions.Work on data lakes and build efficient data models.Collaborate with cross-functional teams to understand business requirements and design solutions accordingly.Optimize ETL performance and troubleshoot issues.Develop and maintain technical documentation.Stay up to date with the latest AWS Glue developments and incorporate new features and functionality into existing solutions.Requirements:Bachelor's degree in Computer Science or a related field.Minimum of 5-10 years of experience in AWS Glue development.Strong experience with ETL development using AWS Glue.Proficient in Python, Spark, and SQL.Experience with AWS services such as S3, Athena, and Redshift.Familiarity with data modeling and designing data lakes.Experience working with cross-functional teams and collaborating on projects.Excellent communication and documentation skills.Ability to troubleshoot and optimize ETL performance.

Responsibility:Create scalable systems and develop innovative algorithm solutions keeping space and time complexity trade-off in considerationExperiment with innovative ideas and where approved contribute to open-sourceManage design, development and deployment of scalable, high volume and real time systems.Research on algorithm improvements and implement high-speed APIs and fast data processing pipelines.Collaborate with other teams including UI and product management to ensure the solution follows the required specifications and is implementableMeasure quality, performance and security of code and document the resultsSkillsGood foundation in Data Structures and algorithms, with ability to decide right approach as per the problem statementAbility to solve complex, multi-part problems and serve the solution as API (through Flask or FastAPI or similar framework)Exceptional programming skills in Python (and optionally open to one more language - like Go)ability to critically assess a requirements and develop an algorithm that combs data sets to arrive at specific conclusionsOpen to assisting other engineers and team members in fulfilling project schedulesGood communication, documentation and reporting skills(preferred) exposure to distributed computing frameworks like Spark(preferred) Research inclination with interest in advanced hashing, scaling, efficient data representation techniques.(optional but preferred) some level of familiarity with cloud services

Working in small teams as well as independently using agile programming techniques.Self-starter who can think outside of the box, and come up with a solution to resolve and mitigate complex problemsAble to extract, transform, and load big data sets.Learn, diagnose and implement features and bug fixes.Implement coding patterns and evangelist of best practices.Develop technical designs for application development.Proper continual knowledge management of work and process.Ensuring effective Design, Development, Validation and Support activities in line with client needs and architectural requirements is given on a timely basis.

Job Responsibilities Design, develop, deploy and maintain solutions on premise or in the cloud. Integrate software components with third-party systems. Troubleshoot, debug and maintain existing software. Recommend and execute improvements to solutions and processes. Create technical documentation for reference and reporting.Qualifications Experience developing with ETL tool (e.g. Talend product suite, Informatica, Boomi) Experience with Java 8+, SQL, No SQL, JSON, XML, XPath and regular expressions. Experience with REST API development. Experience with design patterns and the Software Development Life Cycle. Experience with ETL, ESB, MDM, Data Quality and Data Profiling. Experience with designing logical and physical data models for relational and hierarchicaldata structures. Knowledge of ActiveMQ or other messaging framework. Knowledge of Cloud platforms and services for AWS, Azure or GCP. Knowledge of automated unit testing and integration testing. Knowledge of search frameworks (i.e. Elasticsearch, Solr, Lucene). Knowledge of the Apache Camel and Apache Spark.

Responsibilities Design, develop, deploy and maintain solutions on premise or in the cloud. Integrate software components with third-party systems. Troubleshoot, debug and maintain existing software. Recommend and execute improvements to solutions and processes. Create technical documentation for reference and reporting. Qualifications Experience developing with ETL tool (e.g. Talend product suite, Informatica, Boomi) Experience with Java 8+, SQL, No SQL, JSON, XML, XPath and regular expressions. Experience with REST API development. Experience with design patterns and the Software Development Life Cycle. Experience with ETL, ESB, MDM, Data Quality and Data Profiling. Experience with designing logical and physical data models for relational and hierarchicaldata structures. Knowledge of ActiveMQ or other messaging framework. Knowledge of Cloud platforms and services for AWS, Azure or GCP. Knowledge of automated unit testing and integration testing. Knowledge of search frameworks (i.e. Elasticsearch, Solr, Lucene). Knowledge of the Apache Camel and Apache Spark.

Basic Qualifications5+ years of experience as a Data Engineer or in a similar role3+ years of industry experience in software development, data engineering, business intelligence, data science, or related field3+ years of experience in SQL & PythonBachelor's degree in computer science, engineering, mathematics, or a related technical disciplineExperience with data modelling, data warehousing, and building ETL pipelinesProven track record of solving complex business problem with high quality & automated testing in agile environment.Experience using one of the big data technologies (Spark, EMR, Dbt cloud etc)Excellent communication & analytics skillsPreferred QualificationsExperience working with AWS big data technologies (EMR, Redshift, S3, Lambda, RDS)Experience working with SnowflakeDemonstrated strength in data modeling, ETL development, and data warehousingExcellent understanding of any other programming languages like Java or JavaScriptExperience working with one of big data schedulers like Airflow, Oozie, Azkaban etc.Experience in data streaming with Kafka, Spark Streaming and KinesisBasic knowledge on Containerization and Orchestration like Docker, KubernetesUnderstanding of python data libraries like NumPy, Scikit-Learn etc.Open to learn new technologies & AI libraries