Data Engineer Job Vacancies in Hyderabad

Data Engineer HyderabadExperience: 48 years Location: Bangalore Employment Type: Full-timeAbout the RoleWere seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and integrations across multiple systems. Youll work with Python, GCP (BigQuery), Spark, and API integrations, ensuring data quality and seamless workflows. Experience with Ascend.io is a plus.Key ResponsibilitiesDesign and develop ETL/ELT pipelines and automated workflows.Integrate data from APIs, Oracle EBS, and cloud platforms.Leverage Google Cloud Platform (GCP) and BigQuery for data analytics.Utilize Apache Spark or similar frameworks for large-scale data processing.Ensure data accuracy, consistency, and security across systems.Collaborate with business and data teams to deliver reliable data solutions.Monitor and troubleshoot pipeline performance.RequirementsStrong Python and workflow orchestration experience (Airflow, Prefect, etc.).Hands-on with GCP / BigQuery and big data frameworks (Spark).Experience with API integrations (REST, SOAP, GraphQL).Understanding of ETL optimization, CI/CD, and Agile workflows.Excellent problem-solving and communication skills.Nice to HaveExperience with Ascend.io.Knowledge of SQL/NoSQL, Docker, Kubernetes.Exposure to machine learning pipelines.Why Join UsWork on cutting-edge data engineering and cloud-based integration projects.Collaborative, innovative team environment.Competitive compensation and strong career growth.

DETAILED RESPONSIBILITIES Design complex systems that integrate GenAI applications, machine learning models, and cloud infrastructure. Lead and manage a diverse, cross-functional team of engineers, ensuring the delivery of high-quality, scalable solutions. Engage in hands-on coding, technical design, and problem-solving to drive innovation and excellence. Make critical architectural decisions to optimize performance, scalability, and reliability of systems. Collaborate with stakeholders to align technological solutions with business objectives. Stay updated with emerging technologies and industry best practices to ensure continuous improvement.SKILL REQUIREMENTS Hands-on experience in GCP, Data Engineering, or DevOps is highly advantageous. Minimum 8+ years of hands-on experience in software engineering, with at least 3+ years in a leadership role managing cross-functional teams. Proficiency in designing and developing large-scale systems, including GenAI, API architectures, data systems, and cloud-native applications. Strong programming skills in Python, JavaScript, Java, or other backend languages. Experience with API development (RESTful APIs, GraphQL). Extensive experience in building and deploying ML models using TensorFlow, PyTorch, scikit-learn, and spaCy. Strong leadership and team management skills, with excellent problem-solving abilities and effective communication skills. Familiarity with industry best practices and emerging technologies in AI and machine learning.

About the RoleWe are looking for a highly skilled and experienced Senior Data Engineer to join our team in Hyderabad. The ideal candidate will bring strong technical expertise in building scalable data platforms and pipelines using modern technologies such as Python, Scala, AWS, Redshift, Terraform, Jenkins, and Docker. This role demands a hands-on professional who thrives in a fast-paced, collaborative environment and is eager to solve complex data problems.Key ResponsibilitiesDesign, build, and optimize robust, scalable, and secure data pipelines and platform components.Collaborate with data scientists, analysts, and engineering teams to ensure seamless data flow, integration, and availability across systems.Develop infrastructure as code using Terraform to automate provisioning and environment management.Manage containerized services and workflows using Docker.Set up, manage, and optimize CI/CD pipelines using Jenkins for continuous integration and deployment.Optimize performance, scalability, and reliability of large-scale data systems on AWS.Write clean, modular, and efficient code in Python and Scala to support ETL, data transformation, and processing tasks.Support data architecture planning and participate in technical reviews and design sessions.Must-Have SkillsStrong hands-on experience with Python, Scala, SQL, and Amazon Redshift.Proven expertise in AWS cloud services and ecosystem (EC2, S3, Redshift, Glue, Lambda, etc.).Experience implementing Infrastructure as Code (IaC) with Terraform.Proficient in managing and deploying Docker containers in development and production environments.Hands-on experience with CI/CD pipelines using Jenkins.Strong understanding of data architecture, ETL pipelines, and distributed data processing systems.Excellent problem-solving skills and ability to mentor junior engineers.Nice-to-HaveExperience working in regulated domains like healthcare or finance.Exposure to Apache Airflow, Spark, or Databricks.Familiarity with data quality frameworks and observability tools.

Strong hands-on experience on C#, SQL Server, OOPS Concepts, Micro Services Architecture. At least one-year hands-on experience on .NET Core, ASP.NET Core, Web API, SQL, No SQL, Entity Framework 6 or above, Azure, Database performance tuning, Applying Design Patterns, Agile. Net back-end development with data engineering expertise. Must have experience with Azure Data Engineering, Azure Databricks, MS Fabric as data platform/ Snowflake or similar tools. Skill for writing reusable libraries. Excellent Communication skills both oral & written. Excellent troubleshooting and communication skills, ability to communicate clearly with US counter parts

Are you a fun loving and passionate to be a part of Global Innovator team? Are you planning to grow your career, which enhance your skills in technology? A career in IT can open many doors for you in the world of technology. If you are looking for a company that is dedicated to your ideas, recognizes you for your unique competency & contributions and provides a fun, flexible and delightful work atmosphere.Then, we are the right place to ignite your passion. We are totally committed about our employees, our Clients & Customers, our work culture and especially our technology. We are a flat organization where opportunities are provide based on talent and we always encourage new ideas of employees through collaboration and creativity.We are seeking for smart-driven IT JAVA/dotnet/python Programmers to join us. The candidate will work with the global product development team and subject matter experts. An ideal candidate must possess excellent business skills with outstanding Analytical & logical skills, professionalism, Intelligent and should have the zeal to learn.Core Competency:Masters or bachelors degree in Engineering (CSE / IT / MCA /or any fresher looking to work in Software) are preferred.Passionate Fresher who can wok in technologies into Java,dotnet ,python,sql applications.Possesses intellectual humility; smart-driven, creative and able to learn things from slipups, willing to raise others up.Excellent Logical & Analytical skills with integrated professionalism at all levels.Strong Knowledge in Java, Frame-works like Spring, Spring boot (Mandatory); J2EE technologies like Servlets, JSP and Web Application Server or dotnet(c#,aspdotnet,python,reactjs,angular,ui or ux deigning).Good knowledge in web technologies like HTML, Java Script, XML and CSS.Candidates must be team players, have a thirst for knowledge, the energy to work in a fast-paced environment and a desire to grow in an entrepreneurial company.Key Responsibilities:The role is responsible for designing, coding and deploying of high-performance applications.Excellent interpersonal, Communication and effective organizational skills with solid technical skills.Should be able to communicate effectively with both technical and non-technical personnel.Excellent trouble shootings & problem-solving skills.Practical Knowledge with SDLC from requirement analysis through testing and deployment is a plus.Devising possible solutions to anticipated problems.Develop and maintain strong product knowledge.Guide the clients through various stages of the project and transition to support organization.Review existing business processes and participate in the Process Improvement Program.

Dear Candidate ,Give dynamic start to your career with VMS Group SECRET TECHNOLOGIES INDIA , we are looking for freshers and experienced candidates who want to make good career in IT or NON It field.Job Type: Full time.Eligibility criteria : Fresher /Experience 0-5 Year.Location : Pune. OR PAN INDIADesired Qualification - Any Bachelor degree Minimum BA ,B.Com - Commerce, B.E , B.Tech, M.Sc , M.C.A B.C.A ,Any Graduates, Post Graduates, can also apply. Should be comfortable to work any location of pune or Pan India.Your application for theTesting & DevelopmentBack Office / Data EntryTechnical Support, Non-Voice ProcessBDE (canadian, US, UK)-In HouseBusiness Development Executive, On FieldOperations/Customer Service , Customer Service (Web)BPO MNC and Domestic ( Hindi Marathi or Any local language)Accounts & Finance /Financial AnalystPosition stood out to us and we would like to invite you for a Face to face interview Telephone interview at our office to get to know you a bit better.You will meet with the MR. Prem Sir or Aishwarya Ma'am.The interview will last about 20 minutes and you'll have the chance to discuss the above position and learn more about our company. Please carry your updated resume at list Two CopiesDesired Candidate - Candidate should be Dynamic, Enterprising, Presentable with excellent communication and written skills.If candidate is interested please visit our office. Monday to Saturday 10 am to 5 pm bitwin anytime Meet- Prem Sir / Ms. Aishwarya Ma'am Interview Venue-building A -15th , city vista, foundation road, Kharadi, Pune, Maharashtra 411014We will take 2 rounds of an interview.-Contact No. 7066165593 Aishwarya Ma'am 7066147637 Prem Sir 1. HR Round and simple logic checking P.I round.2. Technical HR Final round by Senior HR Manager.Thanks & Regards SECRET TECHNOLOGIES INDIA VMS GROUP Placement / Contract Labour / Real EstateAddress -building A -15th , city vista, foundation road, Kharadi, Pune, Mahara

3+ years of experience in AI/ML engineering or related fields.Proficiency in Python and machine learning frameworks (TensorFlow, PyTorch, Scikit-learn, etc.).Strong understanding of data science concepts, including statistical analysis and predictive modeling.Experience working with large datasets and cloud platforms (AWS, Google Cloud, Azure).Solid understanding of algorithms, data structures, and optimization techniques.Experience with data preprocessing, model training, and deployment.Familiarity with natural language processing (NLP) and computer vision (CV) is a plus.Strong problem-solving skills and ability to work in an agile environment.

Level of skills and experience:5 years of hands-on experience in using Python, Spark,Sql.Experienced in AWS Cloud usage and management.Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow).Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch.Experience with orchestrators such as Airflow and Kubeflow.Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).Fundamental understanding of Parquet, Delta Lake and other data file formats.Proficiency on an IaC tool such as Terraform, CDK or Cloud Formation.Strong written and verbal English communication skill and proficient in communication with non-technical stakeholderst

Technical Skills: In-depth knowledge of AWS services (IAM, Redshift, Step Functions) Infrastructure as code tools (CloudFormation Stack) Database technologies (SQL, NoSQL) Data processing and analysis tools (AWS Glue, EMR) Big data frameworks (Hadoop, Spark) ETL tools (IBM DataStage, ODI, Informatica, Talend, Microsoft SQL Server Integration Services, Apache Nifi) Data warehousing architecture, Architecture Design Collaboration tools (JIRA, Confluence).If you are looking for a new challenge and have the relevant experience, apply now or tag someone who'd be perfect for this role.Send your resume to : hr@talme.in

Dear Candidates,Greetings from Rightfit Resources!We are hiring for the following position:Position: IT Consultant Salary: 12,000 to 55,000 per month Qualification: Fresher / ExperiencedIf you are passionate, motivated, and looking to join a dynamic team, we want to hear from you! Apply now and take your career to the next level with Rightfit Resources.How to Apply: Submit your resume via this link.Note: Only shortlisted candidates will be contacted for the interview process.

Advancesoft India Private limited (a subsidiary of Advancesoft Inc., USA) is looking to hire AWS Data Engineers, with 4+ yrs of Hands-on exp., to work closely with our agile software team. If you enjoy working in a dynamic environment and are a self-driven individual, we wish to speak to you.Roles and Responsibilities: Set up process for Data Management, working on automated Analytical Modules. Continuously focus on improvement and automation by partnering with different teams Create POCs of new ideas, scale them into solutions - e.g., integration of new channels, workflows to support new product journeys, and testing new communication frameworks! The person would lend Data Engineering support on creation and execution of omnichannel campaigns for the bank. Working alongside campaign managers for Rule definition, logical coding of the rules, creation of campaign files Prepare data layer and support for the analytics and data science team Help in integration of new sources of data, pipelines. Lead the data development of new analytical modules and automated customer journeys Maintain and improve already existing processes. Provide automation support and backup to the Prod Support TeamQualifications: 4+ years of work experience in Data Engineering with experience in Big Data. Banking domain knowledge is a plus Strong and hands on knowledge of SQL, Python, PySpark. Strong analytical experience in writing complex queries, query optimization, debugging, user defined functions etc. in PySpark Has worked in AWS with familiarity to Airflow and DAGs. Knowledge of AWS Cloud integration with Apache Spark, EMR, Athena, Glue, Kafka, Lambda, S3, Redshift is desirable. Knowledge of PostgreSQL and Docker Has experience in processing large Structured and non-structured file from multiple sources Has experience working on JIRA or similar project management tools Profiles to be sent to contact@advancesoftinc.com

SkillSAP BTP Integration SuiteSAP APO +GATPSAP APO +TVPSSAP SF + VPSAP SF + CDPSAP CPI with PI/POSAP PM With MRSSAP SF With RCM and OBMSenior Data EngineerData Engineer LeadSAP CPI consultantSAP CAP consultantSAP UI5 consultantSAP ABAP+HANA consultant

Strong experience with Microsoft Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure SQL Database.Proficiency in ETL processes, data pipeline design, and automation within the Azure ecosystem.Experience with big data technologies such as Apache Spark, Hadoop, Azure HDInsight, and Databricks.Solid understanding of data modeling, data warehousing concepts, and relational and non-relational databases.Strong knowledge of SQL and experience with scripting languages like Python, R, or Scala.Experience with Azure Storage services, such as Blob Storage, Data Lake Storage, and Azure Cosmos DB.Familiarity with Data Governance, Data Lineage, and Data Security practices in the cloud.Hands-on experience with Azure DevOps for CI/CD pipeline management, version control, and deployment automation.Familiarity with Azure Active Directory (AAD) and role-based access control (RBAC) for managing permissions and security.Experience with RESTful APIs and integrating with third-party systems for data ingestion and export.Strong problem-solving and analytical skills, with the ability to work with large datasets and derive actionable insights.Ability to collaborate effectively with stakeholders and communicate complex data engineering concepts in simple terms.Preferred Qualifications:Azure certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect Expert.Experience with real-time data processing using Azure Stream Analytics or Apache Kafka.Knowledge of machine learning and AI concepts for data-driven decision-making.Familiarity with Power BI or other reporting tools for data visualization.Experience with Agile methodologies in a data engineering environment.

Detailed Job Description:We are looking for an Ataccama Admin to join our team and help us manage and maintain our Ataccama data quality and data governance platform. You will be responsible for installing, configuring, and maintaining Ataccama on AWS/Azure platform, as well as developing and implementing data quality rules and policies. You should have a deep understanding of Ataccama architecture and best practices, as well as experience in data management and data governance. Experience in administering Collibra and Immuta is preferred. You should also have experience in managing VMs and Windows and Linux based systems. Pharma experience is preferred.Essential Duties and Responsibilities: Install, configure, and maintain Ataccama Develop and implement data quality rules and policies Monitor and report on data quality metrics Troubleshoot and resolve Ataccama-related issues Stay up-to-date on the latest Ataccama features and best practices Work with cross-functional teams to implement data governance policies and procedures Manage and maintain VMs and Windows and Linux based systems Manage redundancy, backup and recovery plans and processes Strong AWS/Azure experienceQualifications: 4+ years of experience with Ataccama Experience in data management and data governance Experience in administering Collibra and Immuta is preferred Experience in managing VMs and Windows and Linux based systems Experience in Performance Tuning Pharma experience is preferred Strong analytical and problem-solving skills Excellent communication and teamwork skills

We are looking for a Machine Learning (ML) Data engineer who will partner with application teams and assist with data analysis and research; conducting tactical data extracts and build balanced ML and Data pipelines; deploy AI/ML models and build reports to measure deployed model efficiency.Key Responsibilities: Understanding business objectives and developing models that help to achieve them, along with metrics to track their progress Analyzing the ML algorithms that could be used to solve a given problem and ranking them by their success probability Exploring and visualizing data to gain an understanding of it, then identifying differences in data distribution that could affect performance when deploying the model in the real world Verifying data quality, and/or ensuring it via data cleaning Supervising the data acquisition process if more data is needed Finding available datasets online that could be used for training Defining validation strategies Defining the preprocessing or feature engineering to be done on a given dataset Defining data augmentation pipelines Training models and tuning their hyperparameters Analyzing the errors of the model and designing strategies to overcome them Deploying models to productionRequired Hands-on experience in Data Warehouse, ETL, Data Modeling & Reporting. 7+ years of hands-on experience in productizing and deploying Big Data platforms and applications, Hands-on experience working with: Relational/SQL, distributed columnar data stores/NoSQL databases, time-series databases, Spark streaming, Kafka, Hive, Redshift and more Familiarity with data pipelines and ML pipelines right from Data Extraction to Insights generation Highly skilled in SQL, Python, Spark, AWS S3, Hive Data Catalog, Parquet, Redshift, Airflow, and Tableau or similar tools. Proven experience in building a Custom Enterprise Data Warehouse or implementing tools like Data Catalogs, Spark, Tableau, Kubernetes, and Docker D

Need to train the candidates

Job Title: Data Science SpecialistCompany: SizmaraiLocation: remoteEmployment Type: Full-timeSalary: 80k-125k $About Sizmarai:Sizmarai is a leader in AI-driven text-to-video transformation, making video content creation accessible and impactful. Were growing rapidly and are seeking a Data Science Specialist passionate about innovation to enhance our platform.Job Overview:As a Data Science Specialist, youll be essential in advancing our AI text-to-video platform. This role requires analytical expertise, creativity, and technical skills to refine algorithms and work closely with AI researchers and engineers to push the boundaries of AI-generated videos.Key Responsibilities:Develop and deploy machine learning models for text-to-video generation.Analyze datasets to optimize AI systems and identify trends.Collaborate with teams to translate business needs into data-driven solutions.Innovate in NLP, computer vision, and deep learning to improve platform capabilities.Ensure data quality throughout the pipeline.Stay current with AI and machine learning advancements.Communicate technical concepts to various stakeholders.Qualifications:Bachelors or Masters in Data Science, AI, Computer Science, or related field.Experience in data science, preferably in AI or video tech.Proficiency in Python, R, or SQL.Strong background in deep learning frameworks and machine learning libraries.Expertise in NLP and computer vision.Familiarity with cloud platforms and big data technologies.Excellent analytical and communication skills.Passion for continuous learning.What We Offer:Competitive salary and benefits.Work with cutting-edge AI technology.A collaborative, inclusive environment.Opportunities for growth and learning.Flexibility to work remotely or in-office.How to Apply:If youre passionate about AI and eager to innovate in video content creation, you can check our web at sizmar.world and contact us at careeratsizmarai@gmail.com

Write effective python code to tackle complex issues, but also use your business sense and analytical abilities to glean valuable insights from public database.Clearly express reasoning and logic when Writing code in Jupiter notebooks or other suitable mediums Fix bugs in the code and create through documentation Utilize extensive data analysis skills to develop and respond to important business queries using available datasetsEffectively communicate with researchers to comprehend the needs and provide the results

DETAILED RESPONSIBILITIES Design complex systems that integrate GenAI applications, machine learning models, and cloud infrastructure. Lead and manage a diverse, cross-functional team of engineers, ensuring the delivery of high-quality, scalable solutions. Engage in hands-on coding, technical design, and problem-solving to drive innovation and excellence. Make critical architectural decisions to optimize performance, scalability, and reliability of systems. Collaborate with stakeholders to align technological solutions with business objectives. Stay updated with emerging technologies and industry best practices to ensure continuous improvement.SKILL REQUIREMENTS Hands-on experience in GCP, Data Engineering, or DevOps is highly advantageous. Minimum 8+ years of hands-on experience in software engineering, with at least 3+ years in a leadership role managing cross-functional teams. Proficiency in designing and developing large-scale systems, including GenAI, API architectures, data systems, and cloud-native applications. Strong programming skills in Python, JavaScript, Java, or other backend languages. Experience with API development (RESTful APIs, GraphQL). Extensive experience in building and deploying ML models using TensorFlow, PyTorch, scikit-learn, and spaCy. Strong leadership and team management skills, with excellent problem-solving abilities and effective communication skills. Familiarity with industry best practices and emerging technologies in AI and machine learning.

we are in the lookout for a seasoned Cloud Data Lead. We are eager to connect with you if you have extensive experience in cloud platforms, data architecture, and leadership!