ETL Job Vacancies in Pune

3+ years of AWS data engineering: Glue, Step Functions, Lambda, S3, DynamoDB, EC2Strong Python (boto3) scripting for automationTerraform or CloudFormation expertiseHands-on experience integrating RAG workflows or deploying LLM applicationsSolid SQL and NoSQL data-modeling skillsExcellent written and verbal communication in client-facing contexts

Responsibilities: Design, develop, and deploy data solutions on Azure, leveraging SQL Azure,Azure Data Factory, and Databricks. Build and maintain scalable data pipelines to ingest, transform, and load datafrom various sources into Azure data repositories. Implement data security and compliance measures to safeguard sensitiveinformation. Collaborate with data scientists and analysts to support their data requirementsand enable advanced analytics and machine learning initiatives. Optimize and tune data workflows for performance and efficiency. Troubleshoot data-related issues and provide timely resolution. Stay updated with the latest Azure data services and technologies andrecommend best practices for data engineering.Qualifications: Bachelors degree in computer science, Information Technology, or related field. Proven experience as a data engineer, preferably in a cloud environment. Strong proficiency in SQL Azure for database design, querying, and optimization. Hands-on experience with Azure Data Factory for ETL/ELT workflows. Familiarity with Azure Databricks for big data processing and analytics. Experience with other Azure data services such as Azure Synapse Analytics,Azure Cosmos DB, and Azure Data Lake Storage is a plus. Solid understanding of data warehousing concepts, data modeling, anddimensional modeling. Excellent problem-solving and communication skills.

Skill Name: ETL Automation TestingLocation: Bangalore, Chennai and Pune (wfo)Experience: 4+ YearsRequired:Experience in ETL Automation TestingStrong experience in PythonStrong experience in Pyspark.

Job Openings for 5 AWS Developer Jobs with minimum 8 Years Experience in Chennai, Pune, Greater Hyderabad, Delhi NCR, having Educational qualification of : Professional Degree with Good knowledge in AWS, ETL Consultant, ETL Tool etc.

Work Mode: Hybrid6-9 years of overall IT experience, preferably in cloud environments.Minimum of 5 years of hands-on experience with AWS cloud development projects.Design and develop AWS data architectures and solutions.Build robust data pipelines and ETL processes using big data technologies.Utilize AWS data services such as Glue, Lambda, Redshift, and Athena effectively.Implement infrastructure as code (IaC) using Terraform.Proficiency in SQL, Python, and other relevant programming/scripting languages.Experience with orchestration tools like Apache Airflow or AWS Step Functions.Strong understanding of data warehousing concepts, data lakes, and data governance frameworks.Expertise in data modeling for both relational and non-relational databases.Excellent communication skills are essential for this role.

We are Looking for Software Engineers Freshers and Experience

Datastage Sr. Developer - Job Description:Strong hands on experience on DataStage developmentKnowledge of PL/SQLStrong analytical skillsKnowledge of Teradata, Snowflake, Snaplogic will be add-ons, to primary skillsGood Communication SkillsReady to work in second shiftExperience : 5-7 years

Data Platform Lead Location: PuneExp: 7+Years We are looking to hire an ETL Technical Lead with strong hands-on experience in leading complex and large-scale data integration and consolidation initiatives. This role will involve understanding business requirements, analyzing technical options, and providing end-to-end ETL Solutions. It is a challenging role with the opportunity to build innovative Cloud Data integration solutions. Required Past Experience: 7+ Years experience in Informatica or DataStage ETL experience. Handled at least 4+ development projects from ETL Perspective. Designed and Developed ETL Pipeline for heterogeneous sources File (CSV, XML, JSON.) Processing Expertise in Shell/Python Scripting Hand-On Experience to write ETL Logic in SQL or PL/SQL ETL Testing and Troubleshooting Performed Performance Optimization of ETL Pipelines Provided technical guidance to Team Members. Performed Code Reviews Experience in Data Modeling Involvement in Data Pipeline Design with an Architect. Required Skills and Abilities: Mandatory Skills - Hands-on and deep experience working as a lead in ETL Development with Informatica or DataStage, Strong in SQL Query. Secondary Skills - Data Modeling and Shell Scripting Pipeline Design and Code Optimization Good to have - Ability Design and Build a Cloud ETL Pipeline Good verbal and written communication skills. Ability to communicate with customers, developers, and other stakeholders. Mentor and guide team members Good Presentation skills Strong Team Player About Us! A global Leader in the Data Warehouse Migration and Modernization to the Cloud, we empower businesses by migrating their Data/Workload/ETL/Analytics to the Cloud by leveraging Automation.

We are looking for a highly skilled AWS Glue Developer with a minimum of 5-10 years of experience in the industry to join our team at IBM India. The ideal candidate will be responsible for developing and maintaining data integration solutions using AWS Glue, building ETL pipelines, and working on data lakes.Responsibilities:Develop and maintain ETL pipelines using AWS Glue.Design and develop data integration solutions using AWS Glue.Develop and maintain data ingestion, transformation, and integration solutions.Work on data lakes and build efficient data models.Collaborate with cross-functional teams to understand business requirements and design solutions accordingly.Optimize ETL performance and troubleshoot issues.Develop and maintain technical documentation.Stay up to date with the latest AWS Glue developments and incorporate new features and functionality into existing solutions.Requirements:Bachelor's degree in Computer Science or a related field.Minimum of 5-10 years of experience in AWS Glue development.Strong experience with ETL development using AWS Glue.Proficient in Python, Spark, and SQL.Experience with AWS services such as S3, Athena, and Redshift.Familiarity with data modeling and designing data lakes.Experience working with cross-functional teams and collaborating on projects.Excellent communication and documentation skills.Ability to troubleshoot and optimize ETL performance.

Responsibility:Create scalable systems and develop innovative algorithm solutions keeping space and time complexity trade-off in considerationExperiment with innovative ideas and where approved contribute to open-sourceManage design, development and deployment of scalable, high volume and real time systems.Research on algorithm improvements and implement high-speed APIs and fast data processing pipelines.Collaborate with other teams including UI and product management to ensure the solution follows the required specifications and is implementableMeasure quality, performance and security of code and document the resultsSkillsGood foundation in Data Structures and algorithms, with ability to decide right approach as per the problem statementAbility to solve complex, multi-part problems and serve the solution as API (through Flask or FastAPI or similar framework)Exceptional programming skills in Python (and optionally open to one more language - like Go)ability to critically assess a requirements and develop an algorithm that combs data sets to arrive at specific conclusionsOpen to assisting other engineers and team members in fulfilling project schedulesGood communication, documentation and reporting skills(preferred) exposure to distributed computing frameworks like Spark(preferred) Research inclination with interest in advanced hashing, scaling, efficient data representation techniques.(optional but preferred) some level of familiarity with cloud services

Technologies / Skills: Advanced SQL, Python and associated libraries like Pandas, Numpy etc., Pyspark , Shell scripting, Data- Modelling, Big data, Hadoop, Hive, ETL pipelines and IaC tools like Terraform etc.Responsibilities: Efficient communication skills to coordinate with users, technical teams and DataSolution architects. Document technical design documents for given requirements or JIRA stories. Communicate results and business impacts of insight initiatives to key stakeholders to collaboratively solve business problems. Working closely with the overall Enterprise Data & Analytics Architect and Engineering practice leads to ensure adherence with the best practices and design principles. Assures quality, security and compliance requirements are met for supported area. Develop fault-tolerance data pipelines running on cluster Ability to come up with scalable and modular solutionsRequired Qualification: 1-8 yrs of hands-on experience developing data pipelines for Data Ingestion or transformation using Python (PySpark) /Spark SQL in AWS cloud Experience in development of data pipelines and processing of data at scale using technologies like EMR, Lambda, Glue, Athena, Redshift, Step Functions. Advanced experience in writing and optimizing efficient SQL queries with Python and Hive handling Large Data Sets in Big-Data Environments Experience in debugging, tunning and optimizing PySpark data pipelines Should have implemented concepts and have good knowledge of Pyspark data frames, joins, partitioning, parallelism etc. Understanding of Spark UI, Event Timelines, DAG, Spark config parameters, in order to tune the long running data pipelines. Experience working in Agile implementations Experience with Git and CI/CD pipelines to deploy cloud applications Good knowledge of designing Hive tables with partitioning for performanceThanks and RegardsHR TEAM

**Preference will be given to the candidates who can join on or before 1st of October, 2022**You will:Write excellent production code and tests and help others improve in code-reviewsAnalyze high-level requirements to design, document, estimate, and build systemsCoordinate across teams to identify, resolve, mitigate and prevent technical issuesCoach and mentor engineers within the team to develop their skills and abilitiesContinuously improve the team's practices in code-quality, reliability, performance, testing, automation, logging, monitoring, alerting, and build processesYou have:For (Full stack):2 - 10 Years of experienceStrong with DS & AlgorithmsHands on Experience in the Programming languages: JavaScript (React or Angular), Python, SQL.Experience with AWS.For (Backend):2 - 10 years of experienceHands on product development experience using Java/ C++/PythonExperience with AWS,SQL,GITStrong with Data structures and AlgorithmsAdditional nice to have skills/certifications:For Java skill set:Mockito, Grizzly, Netty, VertX, Jersey / JAX-RS, Swagger / Open API, Nginx, Protocol Buffers, Thrift, Aerospike, Redis, Kinesis, Sed, Awk, PerlFor Python skill set: Data Engineering experience, Athena, Lambda, EMR, Spark, Glue, Step Functions, Hadoop, Kinesis, Orc, Parquet, Perl, Awk, RedshiftFor (Data Engineering):2 - 10 years of experienceExperience with object-oriented/object function scripting languages: Python.Experience with AWS cloud services: EC2, RDS, Redshift,S3,Athena, GlueMust be proficient in GIT, Jenkins, CICD (Continuous Integration Continuous Deployment)Experience in big data technologies like Hadoop, Map Reduce, Spark, etcExperience with Amazon Web Services and DockersFor (Geo Team):4 - 10 years of experienceExperience with Big Data technologies like Hadoop, Spark, Map Reduce, Kafka, etcExperience using object-oriented languages (Java, Python)Experience in working with different AWS technologies.Experience in software

Working in small teams as well as independently using agile programming techniques.Self-starter who can think outside of the box, and come up with a solution to resolve and mitigate complex problemsAble to extract, transform, and load big data sets.Learn, diagnose and implement features and bug fixes.Implement coding patterns and evangelist of best practices.Develop technical designs for application development.Proper continual knowledge management of work and process.Ensuring effective Design, Development, Validation and Support activities in line with client needs and architectural requirements is given on a timely basis.

Job Responsibilities Design, develop, deploy and maintain solutions on premise or in the cloud. Integrate software components with third-party systems. Troubleshoot, debug and maintain existing software. Recommend and execute improvements to solutions and processes. Create technical documentation for reference and reporting.Qualifications Experience developing with ETL tool (e.g. Talend product suite, Informatica, Boomi) Experience with Java 8+, SQL, No SQL, JSON, XML, XPath and regular expressions. Experience with REST API development. Experience with design patterns and the Software Development Life Cycle. Experience with ETL, ESB, MDM, Data Quality and Data Profiling. Experience with designing logical and physical data models for relational and hierarchicaldata structures. Knowledge of ActiveMQ or other messaging framework. Knowledge of Cloud platforms and services for AWS, Azure or GCP. Knowledge of automated unit testing and integration testing. Knowledge of search frameworks (i.e. Elasticsearch, Solr, Lucene). Knowledge of the Apache Camel and Apache Spark.

Basic Qualifications5+ years of experience as a Data Engineer or in a similar role3+ years of industry experience in software development, data engineering, business intelligence, data science, or related field3+ years of experience in SQL & PythonBachelor's degree in computer science, engineering, mathematics, or a related technical disciplineExperience with data modelling, data warehousing, and building ETL pipelinesProven track record of solving complex business problem with high quality & automated testing in agile environment.Experience using one of the big data technologies (Spark, EMR, Dbt cloud etc)Excellent communication & analytics skillsPreferred QualificationsExperience working with AWS big data technologies (EMR, Redshift, S3, Lambda, RDS)Experience working with SnowflakeDemonstrated strength in data modeling, ETL development, and data warehousingExcellent understanding of any other programming languages like Java or JavaScriptExperience working with one of big data schedulers like Airflow, Oozie, Azkaban etc.Experience in data streaming with Kafka, Spark Streaming and KinesisBasic knowledge on Containerization and Orchestration like Docker, KubernetesUnderstanding of python data libraries like NumPy, Scikit-Learn etc.Open to learn new technologies & AI libraries

Responsibilities Design, develop, deploy and maintain solutions on premise or in the cloud. Integrate software components with third-party systems. Troubleshoot, debug and maintain existing software. Recommend and execute improvements to solutions and processes. Create technical documentation for reference and reporting. Qualifications Experience developing with ETL tool (e.g. Talend product suite, Informatica, Boomi) Experience with Java 8+, SQL, No SQL, JSON, XML, XPath and regular expressions. Experience with REST API development. Experience with design patterns and the Software Development Life Cycle. Experience with ETL, ESB, MDM, Data Quality and Data Profiling. Experience with designing logical and physical data models for relational and hierarchicaldata structures. Knowledge of ActiveMQ or other messaging framework. Knowledge of Cloud platforms and services for AWS, Azure or GCP. Knowledge of automated unit testing and integration testing. Knowledge of search frameworks (i.e. Elasticsearch, Solr, Lucene). Knowledge of the Apache Camel and Apache Spark.

Position: Data Engineer with Python.Location: RemoteDuration: 6 to 12 months+Work hours: 2/3 pm to 10/11 pm ISTType - ContractMinimum 5+ years in Data Engineer role.Expert in PythonFamiliarity with Spark, PySpark.Knowledge in at least any one of the Cloud platform - Azure or GCP or AWSExperience in writing complex and efficient ETL jobs and Data pipelines.Excellent in writing complex SQL Queries and ScriptsProven expertise in modern Data Architecture, Data Modeling, Database architecture, Database Design, Database programming (SQL, Python, etc..)Experience with analytics platforms in Cloud (Azure, GCP, AWS etc..)Experience designing and developing ETL and ELT processes in a variety of platforms (e.g. Azure Data Factory, Data Bricks, etc....)Experience with Data Collaboration Platforms (e.g. Calibra, Alation) and Automated meta data management solutionsExpertise in architecting Master Data Management, Operational Data Stores, Data Lakes, Data Warehousing solutions.

Job opening for SSIS developer with TOP MNC Company Across IndiaDear Candidate, Greetings from Enrich & Enlight!!! Enrich & Enlight is an Executive Search Consulting co, specializing in Middle & Senior Management positions for the selected clientele. We are associated as recruitment partner with reputed organizations in IT, ITES, KPO, Publishing, Consulting and manufacturing industries supporting across India. Currently we are looking professionals for SSIS DeveloperPlease find below the details of the position and reply with your interest. Job Summary:Yrs of Exp: 2 to 8yrs Notice Period: Immediate, 15 Days & 30 Days. Job Location: Across IndiaPosition: Permanent Role: SSIS developerJob Description: Experience in SSIS developer and SQL.Req Skills : ETL, SSIS, SSRS, SQL, Preferred Skill: .Net, SSRS ,SDLC,C#,C Excellent communication skills.Eligibility Criteria: Candidates with Good communication Skills. At least 15 years of regular education. Candidate should not have a career gap of more than 2 years / 24 months in the profile.Interested candidates please do share your updated resumeNote: Only available candidates for Telephonic can share your resumesGood Day!!!Thanks & Regards,Archana

Job description: Minimum 5-7 years of hands-on work experience in BI and Data warehouse projects. At least 4 years of working with Microsoft database platforms MSSQL Server 2012/14/16. Very Good knowledge of T-SQL for writing performant and optimized SQL query. Hands on experience on SQL Server Integration Services(SSIS) - Datawarehouse ETLimplementation. Knowledge of SSIS ETL best practices , Error Handling ,Logging , Re- Tries , Notifications , TaskScheduling. Strong knowledge of various data warehousing methodologies and data modeling concepts. Experience of ETL load design patterns, Incremental load, Full load , Merge etc. Development experience using C# .NET or VB.Net. Experience in Analysis and Reporting solutions using dashboard visualization tools like: Tableau orPower BI etc. is Advantage. Hands-on experience of SDLC processes for BI projects. Experiences of writing documentation functional requirements , design documents, Test Cases,operation manual etc. Self-motivated , excellent troubleshooting and communication skills , team player.

Engineer Testing-Bluetooth(45362/63/64/65/66)Experience: 2 + YrsLocation: PuneJD: In this Position, the candidate will be responsible for executing both BT and BLE profiles on Bluetooth stack integrated on NXP platform. Along with this, the candidate will be responsible for defining test requirements and test procedures. The candidate will be responsible for execution of these testcases and tracking of Bluetooth product quality. Develop test cases directly from requirements, standards. Responsibilities also include some level of automation work related to testing various aspects of the product including functional, performance, stress, use case interoperability. Candidates will be exposed to the sample apps from the stack and will have to work on script to execute them for the test case. The candidate will work closely with other validation engineers, to understand the specifics of the product, its requirements and its intended usage to develop in-depth validation test plans. Candidate can also work on other stacks for Interop testing for BT and BLE.Skills & Qualification:BE/B-Tech or MS in EE/CS +2 experience Additional qualifications include:- Ideal candidate will have experience in Bluetooth/Bluetooth Low Energy.- Strong understanding of Bluetooth profiles/stack and sniffer tools.- Strong knowledge and work experience on working with multiple Bluetooth stack.- Good knowledge of BT and BLE Profiles and standards. - Strong test case creation, documentation, and communication skills are a must.- Understanding of wireless networks and networking in general a must.- Must be able to investigate an issue, isolate its probable cause, and provide a reliable method for reproducing the issue.- Strong understanding of software engineering and SQA methodologiesInterested candidates can submit their resumes on

Experience : 6-9yrs Notice Period : imm - 60 daysWork location : Pune, Bangalore, Chennai, Mumbai Work mode : Hybrid Key Requirements:- Strong experience in cloud migrations and pipelines- Good understanding of Database and Data Engineering concepts- Hands-on experience in SQL and Python- Experience in Java development- Proficiency in Google Cloud Platform tools like Data Flow, Data Transfer services, and AirFlow- Working knowledge of Data Preprocessing techniques using DataFlow, DataProc, and DataPrep- Familiarity with BigQuery, Kafka, PubSub, GCS, and Schedulers- Proficiency in PostgreSQL is preferred- Experience with real-time and scheduled pipelines- Cloud certification is a plus- Experience in implementing ETL pipelines- Familiarity with MicroServices or Enterprise Application Integration Patterns is advantageous