Data Engineer Female Graduate Jobs in Hyderabad

Data Engineer HyderabadExperience: 48 years Location: Bangalore Employment Type: Full-timeAbout the RoleWere seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and integrations across multiple systems. Youll work with Python, GCP (BigQuery), Spark, and API integrations, ensuring data quality and seamless workflows. Experience with Ascend.io is a plus.Key ResponsibilitiesDesign and develop ETL/ELT pipelines and automated workflows.Integrate data from APIs, Oracle EBS, and cloud platforms.Leverage Google Cloud Platform (GCP) and BigQuery for data analytics.Utilize Apache Spark or similar frameworks for large-scale data processing.Ensure data accuracy, consistency, and security across systems.Collaborate with business and data teams to deliver reliable data solutions.Monitor and troubleshoot pipeline performance.RequirementsStrong Python and workflow orchestration experience (Airflow, Prefect, etc.).Hands-on with GCP / BigQuery and big data frameworks (Spark).Experience with API integrations (REST, SOAP, GraphQL).Understanding of ETL optimization, CI/CD, and Agile workflows.Excellent problem-solving and communication skills.Nice to HaveExperience with Ascend.io.Knowledge of SQL/NoSQL, Docker, Kubernetes.Exposure to machine learning pipelines.Why Join UsWork on cutting-edge data engineering and cloud-based integration projects.Collaborative, innovative team environment.Competitive compensation and strong career growth.

About the RoleWe are looking for a highly skilled and experienced Senior Data Engineer to join our team in Hyderabad. The ideal candidate will bring strong technical expertise in building scalable data platforms and pipelines using modern technologies such as Python, Scala, AWS, Redshift, Terraform, Jenkins, and Docker. This role demands a hands-on professional who thrives in a fast-paced, collaborative environment and is eager to solve complex data problems.Key ResponsibilitiesDesign, build, and optimize robust, scalable, and secure data pipelines and platform components.Collaborate with data scientists, analysts, and engineering teams to ensure seamless data flow, integration, and availability across systems.Develop infrastructure as code using Terraform to automate provisioning and environment management.Manage containerized services and workflows using Docker.Set up, manage, and optimize CI/CD pipelines using Jenkins for continuous integration and deployment.Optimize performance, scalability, and reliability of large-scale data systems on AWS.Write clean, modular, and efficient code in Python and Scala to support ETL, data transformation, and processing tasks.Support data architecture planning and participate in technical reviews and design sessions.Must-Have SkillsStrong hands-on experience with Python, Scala, SQL, and Amazon Redshift.Proven expertise in AWS cloud services and ecosystem (EC2, S3, Redshift, Glue, Lambda, etc.).Experience implementing Infrastructure as Code (IaC) with Terraform.Proficient in managing and deploying Docker containers in development and production environments.Hands-on experience with CI/CD pipelines using Jenkins.Strong understanding of data architecture, ETL pipelines, and distributed data processing systems.Excellent problem-solving skills and ability to mentor junior engineers.Nice-to-HaveExperience working in regulated domains like healthcare or finance.Exposure to Apache Airflow, Spark, or Databricks.Familiarity with data quality frameworks and observability tools.

Strong hands-on experience on C#, SQL Server, OOPS Concepts, Micro Services Architecture. At least one-year hands-on experience on .NET Core, ASP.NET Core, Web API, SQL, No SQL, Entity Framework 6 or above, Azure, Database performance tuning, Applying Design Patterns, Agile. Net back-end development with data engineering expertise. Must have experience with Azure Data Engineering, Azure Databricks, MS Fabric as data platform/ Snowflake or similar tools. Skill for writing reusable libraries. Excellent Communication skills both oral & written. Excellent troubleshooting and communication skills, ability to communicate clearly with US counter parts

Need to train the candidates

Level of skills and experience:5 years of hands-on experience in using Python, Spark,Sql.Experienced in AWS Cloud usage and management.Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow).Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch.Experience with orchestrators such as Airflow and Kubeflow.Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).Fundamental understanding of Parquet, Delta Lake and other data file formats.Proficiency on an IaC tool such as Terraform, CDK or Cloud Formation.Strong written and verbal English communication skill and proficient in communication with non-technical stakeholderst

Technical Skills: In-depth knowledge of AWS services (IAM, Redshift, Step Functions) Infrastructure as code tools (CloudFormation Stack) Database technologies (SQL, NoSQL) Data processing and analysis tools (AWS Glue, EMR) Big data frameworks (Hadoop, Spark) ETL tools (IBM DataStage, ODI, Informatica, Talend, Microsoft SQL Server Integration Services, Apache Nifi) Data warehousing architecture, Architecture Design Collaboration tools (JIRA, Confluence).If you are looking for a new challenge and have the relevant experience, apply now or tag someone who'd be perfect for this role.Send your resume to : hr@talme.in

we are in the lookout for a seasoned Cloud Data Lead. We are eager to connect with you if you have extensive experience in cloud platforms, data architecture, and leadership!

Strong experience with Microsoft Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure SQL Database.Proficiency in ETL processes, data pipeline design, and automation within the Azure ecosystem.Experience with big data technologies such as Apache Spark, Hadoop, Azure HDInsight, and Databricks.Solid understanding of data modeling, data warehousing concepts, and relational and non-relational databases.Strong knowledge of SQL and experience with scripting languages like Python, R, or Scala.Experience with Azure Storage services, such as Blob Storage, Data Lake Storage, and Azure Cosmos DB.Familiarity with Data Governance, Data Lineage, and Data Security practices in the cloud.Hands-on experience with Azure DevOps for CI/CD pipeline management, version control, and deployment automation.Familiarity with Azure Active Directory (AAD) and role-based access control (RBAC) for managing permissions and security.Experience with RESTful APIs and integrating with third-party systems for data ingestion and export.Strong problem-solving and analytical skills, with the ability to work with large datasets and derive actionable insights.Ability to collaborate effectively with stakeholders and communicate complex data engineering concepts in simple terms.Preferred Qualifications:Azure certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect Expert.Experience with real-time data processing using Azure Stream Analytics or Apache Kafka.Knowledge of machine learning and AI concepts for data-driven decision-making.Familiarity with Power BI or other reporting tools for data visualization.Experience with Agile methodologies in a data engineering environment.

Advancesoft India Private limited (a subsidiary of Advancesoft Inc., USA) is looking to hire AWS Data Engineers, with 4+ yrs of Hands-on exp., to work closely with our agile software team. If you enjoy working in a dynamic environment and are a self-driven individual, we wish to speak to you.Roles and Responsibilities: Set up process for Data Management, working on automated Analytical Modules. Continuously focus on improvement and automation by partnering with different teams Create POCs of new ideas, scale them into solutions - e.g., integration of new channels, workflows to support new product journeys, and testing new communication frameworks! The person would lend Data Engineering support on creation and execution of omnichannel campaigns for the bank. Working alongside campaign managers for Rule definition, logical coding of the rules, creation of campaign files Prepare data layer and support for the analytics and data science team Help in integration of new sources of data, pipelines. Lead the data development of new analytical modules and automated customer journeys Maintain and improve already existing processes. Provide automation support and backup to the Prod Support TeamQualifications: 4+ years of work experience in Data Engineering with experience in Big Data. Banking domain knowledge is a plus Strong and hands on knowledge of SQL, Python, PySpark. Strong analytical experience in writing complex queries, query optimization, debugging, user defined functions etc. in PySpark Has worked in AWS with familiarity to Airflow and DAGs. Knowledge of AWS Cloud integration with Apache Spark, EMR, Athena, Glue, Kafka, Lambda, S3, Redshift is desirable. Knowledge of PostgreSQL and Docker Has experience in processing large Structured and non-structured file from multiple sources Has experience working on JIRA or similar project management tools Profiles to be sent to contact@advancesoftinc.com