Data Engineer Job Vacancies in Telangana

Data Engineer HyderabadExperience: 48 years Location: Bangalore Employment Type: Full-timeAbout the RoleWere seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and integrations across multiple systems. Youll work with Python, GCP (BigQuery), Spark, and API integrations, ensuring data quality and seamless workflows. Experience with Ascend.io is a plus.Key ResponsibilitiesDesign and develop ETL/ELT pipelines and automated workflows.Integrate data from APIs, Oracle EBS, and cloud platforms.Leverage Google Cloud Platform (GCP) and BigQuery for data analytics.Utilize Apache Spark or similar frameworks for large-scale data processing.Ensure data accuracy, consistency, and security across systems.Collaborate with business and data teams to deliver reliable data solutions.Monitor and troubleshoot pipeline performance.RequirementsStrong Python and workflow orchestration experience (Airflow, Prefect, etc.).Hands-on with GCP / BigQuery and big data frameworks (Spark).Experience with API integrations (REST, SOAP, GraphQL).Understanding of ETL optimization, CI/CD, and Agile workflows.Excellent problem-solving and communication skills.Nice to HaveExperience with Ascend.io.Knowledge of SQL/NoSQL, Docker, Kubernetes.Exposure to machine learning pipelines.Why Join UsWork on cutting-edge data engineering and cloud-based integration projects.Collaborative, innovative team environment.Competitive compensation and strong career growth.

About the RoleWe are looking for a highly skilled and experienced Senior Data Engineer to join our team in Hyderabad. The ideal candidate will bring strong technical expertise in building scalable data platforms and pipelines using modern technologies such as Python, Scala, AWS, Redshift, Terraform, Jenkins, and Docker. This role demands a hands-on professional who thrives in a fast-paced, collaborative environment and is eager to solve complex data problems.Key ResponsibilitiesDesign, build, and optimize robust, scalable, and secure data pipelines and platform components.Collaborate with data scientists, analysts, and engineering teams to ensure seamless data flow, integration, and availability across systems.Develop infrastructure as code using Terraform to automate provisioning and environment management.Manage containerized services and workflows using Docker.Set up, manage, and optimize CI/CD pipelines using Jenkins for continuous integration and deployment.Optimize performance, scalability, and reliability of large-scale data systems on AWS.Write clean, modular, and efficient code in Python and Scala to support ETL, data transformation, and processing tasks.Support data architecture planning and participate in technical reviews and design sessions.Must-Have SkillsStrong hands-on experience with Python, Scala, SQL, and Amazon Redshift.Proven expertise in AWS cloud services and ecosystem (EC2, S3, Redshift, Glue, Lambda, etc.).Experience implementing Infrastructure as Code (IaC) with Terraform.Proficient in managing and deploying Docker containers in development and production environments.Hands-on experience with CI/CD pipelines using Jenkins.Strong understanding of data architecture, ETL pipelines, and distributed data processing systems.Excellent problem-solving skills and ability to mentor junior engineers.Nice-to-HaveExperience working in regulated domains like healthcare or finance.Exposure to Apache Airflow, Spark, or Databricks.Familiarity with data quality frameworks and observability tools.

Strong hands-on experience on C#, SQL Server, OOPS Concepts, Micro Services Architecture. At least one-year hands-on experience on .NET Core, ASP.NET Core, Web API, SQL, No SQL, Entity Framework 6 or above, Azure, Database performance tuning, Applying Design Patterns, Agile. Net back-end development with data engineering expertise. Must have experience with Azure Data Engineering, Azure Databricks, MS Fabric as data platform/ Snowflake or similar tools. Skill for writing reusable libraries. Excellent Communication skills both oral & written. Excellent troubleshooting and communication skills, ability to communicate clearly with US counter parts

Level of skills and experience:5 years of hands-on experience in using Python, Spark,Sql.Experienced in AWS Cloud usage and management.Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow).Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch.Experience with orchestrators such as Airflow and Kubeflow.Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).Fundamental understanding of Parquet, Delta Lake and other data file formats.Proficiency on an IaC tool such as Terraform, CDK or Cloud Formation.Strong written and verbal English communication skill and proficient in communication with non-technical stakeholderst

Technical Skills: In-depth knowledge of AWS services (IAM, Redshift, Step Functions) Infrastructure as code tools (CloudFormation Stack) Database technologies (SQL, NoSQL) Data processing and analysis tools (AWS Glue, EMR) Big data frameworks (Hadoop, Spark) ETL tools (IBM DataStage, ODI, Informatica, Talend, Microsoft SQL Server Integration Services, Apache Nifi) Data warehousing architecture, Architecture Design Collaboration tools (JIRA, Confluence).If you are looking for a new challenge and have the relevant experience, apply now or tag someone who'd be perfect for this role.Send your resume to : hr@talme.in

SkillSAP BTP Integration SuiteSAP APO +GATPSAP APO +TVPSSAP SF + VPSAP SF + CDPSAP CPI with PI/POSAP PM With MRSSAP SF With RCM and OBMSenior Data EngineerData Engineer LeadSAP CPI consultantSAP CAP consultantSAP UI5 consultantSAP ABAP+HANA consultant

Advancesoft India Private limited (a subsidiary of Advancesoft Inc., USA) is looking to hire AWS Data Engineers, with 4+ yrs of Hands-on exp., to work closely with our agile software team. If you enjoy working in a dynamic environment and are a self-driven individual, we wish to speak to you.Roles and Responsibilities: Set up process for Data Management, working on automated Analytical Modules. Continuously focus on improvement and automation by partnering with different teams Create POCs of new ideas, scale them into solutions - e.g., integration of new channels, workflows to support new product journeys, and testing new communication frameworks! The person would lend Data Engineering support on creation and execution of omnichannel campaigns for the bank. Working alongside campaign managers for Rule definition, logical coding of the rules, creation of campaign files Prepare data layer and support for the analytics and data science team Help in integration of new sources of data, pipelines. Lead the data development of new analytical modules and automated customer journeys Maintain and improve already existing processes. Provide automation support and backup to the Prod Support TeamQualifications: 4+ years of work experience in Data Engineering with experience in Big Data. Banking domain knowledge is a plus Strong and hands on knowledge of SQL, Python, PySpark. Strong analytical experience in writing complex queries, query optimization, debugging, user defined functions etc. in PySpark Has worked in AWS with familiarity to Airflow and DAGs. Knowledge of AWS Cloud integration with Apache Spark, EMR, Athena, Glue, Kafka, Lambda, S3, Redshift is desirable. Knowledge of PostgreSQL and Docker Has experience in processing large Structured and non-structured file from multiple sources Has experience working on JIRA or similar project management tools Profiles to be sent to contact@advancesoftinc.com

Strong experience with Microsoft Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure SQL Database.Proficiency in ETL processes, data pipeline design, and automation within the Azure ecosystem.Experience with big data technologies such as Apache Spark, Hadoop, Azure HDInsight, and Databricks.Solid understanding of data modeling, data warehousing concepts, and relational and non-relational databases.Strong knowledge of SQL and experience with scripting languages like Python, R, or Scala.Experience with Azure Storage services, such as Blob Storage, Data Lake Storage, and Azure Cosmos DB.Familiarity with Data Governance, Data Lineage, and Data Security practices in the cloud.Hands-on experience with Azure DevOps for CI/CD pipeline management, version control, and deployment automation.Familiarity with Azure Active Directory (AAD) and role-based access control (RBAC) for managing permissions and security.Experience with RESTful APIs and integrating with third-party systems for data ingestion and export.Strong problem-solving and analytical skills, with the ability to work with large datasets and derive actionable insights.Ability to collaborate effectively with stakeholders and communicate complex data engineering concepts in simple terms.Preferred Qualifications:Azure certifications such as Microsoft Certified: Azure Data Engineer Associate or Azure Solutions Architect Expert.Experience with real-time data processing using Azure Stream Analytics or Apache Kafka.Knowledge of machine learning and AI concepts for data-driven decision-making.Familiarity with Power BI or other reporting tools for data visualization.Experience with Agile methodologies in a data engineering environment.

We are looking for a Machine Learning (ML) Data engineer who will partner with application teams and assist with data analysis and research; conducting tactical data extracts and build balanced ML and Data pipelines; deploy AI/ML models and build reports to measure deployed model efficiency.Key Responsibilities: Understanding business objectives and developing models that help to achieve them, along with metrics to track their progress Analyzing the ML algorithms that could be used to solve a given problem and ranking them by their success probability Exploring and visualizing data to gain an understanding of it, then identifying differences in data distribution that could affect performance when deploying the model in the real world Verifying data quality, and/or ensuring it via data cleaning Supervising the data acquisition process if more data is needed Finding available datasets online that could be used for training Defining validation strategies Defining the preprocessing or feature engineering to be done on a given dataset Defining data augmentation pipelines Training models and tuning their hyperparameters Analyzing the errors of the model and designing strategies to overcome them Deploying models to productionRequired Hands-on experience in Data Warehouse, ETL, Data Modeling & Reporting. 7+ years of hands-on experience in productizing and deploying Big Data platforms and applications, Hands-on experience working with: Relational/SQL, distributed columnar data stores/NoSQL databases, time-series databases, Spark streaming, Kafka, Hive, Redshift and more Familiarity with data pipelines and ML pipelines right from Data Extraction to Insights generation Highly skilled in SQL, Python, Spark, AWS S3, Hive Data Catalog, Parquet, Redshift, Airflow, and Tableau or similar tools. Proven experience in building a Custom Enterprise Data Warehouse or implementing tools like Data Catalogs, Spark, Tableau, Kubernetes, and Docker D

Need to train the candidates

Job Title: Data Science SpecialistCompany: SizmaraiLocation: remoteEmployment Type: Full-timeSalary: 80k-125k $About Sizmarai:Sizmarai is a leader in AI-driven text-to-video transformation, making video content creation accessible and impactful. Were growing rapidly and are seeking a Data Science Specialist passionate about innovation to enhance our platform.Job Overview:As a Data Science Specialist, youll be essential in advancing our AI text-to-video platform. This role requires analytical expertise, creativity, and technical skills to refine algorithms and work closely with AI researchers and engineers to push the boundaries of AI-generated videos.Key Responsibilities:Develop and deploy machine learning models for text-to-video generation.Analyze datasets to optimize AI systems and identify trends.Collaborate with teams to translate business needs into data-driven solutions.Innovate in NLP, computer vision, and deep learning to improve platform capabilities.Ensure data quality throughout the pipeline.Stay current with AI and machine learning advancements.Communicate technical concepts to various stakeholders.Qualifications:Bachelors or Masters in Data Science, AI, Computer Science, or related field.Experience in data science, preferably in AI or video tech.Proficiency in Python, R, or SQL.Strong background in deep learning frameworks and machine learning libraries.Expertise in NLP and computer vision.Familiarity with cloud platforms and big data technologies.Excellent analytical and communication skills.Passion for continuous learning.What We Offer:Competitive salary and benefits.Work with cutting-edge AI technology.A collaborative, inclusive environment.Opportunities for growth and learning.Flexibility to work remotely or in-office.How to Apply:If youre passionate about AI and eager to innovate in video content creation, you can check our web at sizmar.world and contact us at careeratsizmarai@gmail.com

Job Title: Azure Data EngineerLocation: RemoteJob Type: ContractJob DescriptionRequirements:Proven experience as a Data Engineer with a focus on Azure services.Strong expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services.Proficiency in programming languages such as Python, SQL, and Spark.Experience with data modeling, data warehousing, and ETL processes.Knowledge of data security and privacy best practices.Strong problem-solving skills and attention to detail.Excellent communication and collaboration skills.Ability to work independently in a remote setup.Preferred Qualifications:Azure Data Engineer certification.Experience with other cloud platforms an

Write effective python code to tackle complex issues, but also use your business sense and analytical abilities to glean valuable insights from public database.Clearly express reasoning and logic when Writing code in Jupiter notebooks or other suitable mediums Fix bugs in the code and create through documentation Utilize extensive data analysis skills to develop and respond to important business queries using available datasetsEffectively communicate with researchers to comprehend the needs and provide the results

Over 10+ years of Azure Data technologies experienceHigh proficient w/ Azure data technologies including Azure Data Factory, Databricks, Azure Synapse AnalyticsExperience designing and deploying data platforms on MS AzureStrong Experience with MS SQL,TSQL and familiar with AWS DynamoDB, IBM DB2Familiar with RDF/Ontologies a plus.Deep experience in Data Analysis, including source data analysis, data profiling and mapping.Good experience in building data pipelines using ADF/Azure Databricks, Synapse, PySpark, Scala.Proven hands-on experience with a large-scale data warehouse.Hands-on data migration experience from legacy systems to new solutions, such as from on-premises clusters to CloudAbility to learn and adapt to new data technologies.Good problem-solving skills and good communication skills.

We have vacant of 6 Data Engineer Jobs in Gachibowli, Hyderabad, for Freshers Educational Qualification : B.Tech/B.E, Any Master Degree, M.C.A, M.Tech Skill Data Warehousing,SAS-Statistical Analysis System,Informatica,Computer Science,ETL etc.

Job Description:Work with our data engineering team. Attend / participate in daily Agile ceremonies to design, build, test, and release data ingestion pipelines and delivery frameworks consisting of ADF pipelines, MS SQL Server databases, and SSIS jobs. Our team works directly alongside our Customer Success Team, Application development team and Data Engineering team to ingest, refine, and persist client data onto the EBM Catalyst data platform, as well as being responsible for the design and evolution of the EBM Catalyst ingestion framework.Must Have? Transact SQL o 3+ years- experience SQL Server - Transact SQLo SQL Server - Views, Stored Procedures, SQL Agent Jobs? Communicationo Proactive communicator that ensures tasks are understood and manager is informed. o Written communication skills in the form of emails, status updates and process/task documentation ? Othero Solution Oriented problem solvero Ability to work independently with guidance from manager.Nice to Have- Azure Data FactoryDeveloping ETL/ELT solutions (data pipelines, linked services

Experience: 5-8 Years in IT industry.Skill Set: Experience in GCP data analytics services such as dataflow, data fusion, big query and data storage.Responsibility: Responsible for developing Enterprise Knowledge Graph (EKG) to connects all data relevant from the data sources.Unit test and validate the graph lineage.

Job Title - Data EngineerEmployment - Full timeRole - Software EngineerYears of Experience - 4-6YearsNo. of Positions - 3CTC in INR - 13-16LPAEducation - B.tech or Any GraduateWork Location - HyderabadMode Of Work - Work from officeNotice Period - Immediate to 30daysInterview Panel Availability - YesInterview Rounds - L1 - Tech, L2 - Tech, L3- Managerial, HR discussionOffice Timings - Regular Shift TimingsWeekend Drives - NoSalaries paid on - Last day of the monthHiring for : Any specific BU/Practice/Client/Product - Internal Application DevelopmentRole reporting to? Lead Data Engineer - Head of DeliveryMust/Good to Have DetailsMust have - (SQL, Python, Pyspark, Azure Data Factory(ADF)/Azure Synapse Analytics, Azure Data bricks and Data Modelling)Good to have - (C#, Scala, any Visualization tool like Power BI, Tableau, SSRS)About the Role - (Related to Data Engineering , ETL, ELT & Designing Data Models.)

Mode of working - OnsiteWork Location- HyderabadRoles and ResponsibilitiesThe Maps team is developing tools to analyze, visualize, process, manage and curate data at large scale. Our team combines disparate signals such as data analytics, community engagement, and user feedback to improve the Maps Platform.As an Engineer, you are responsible to analyze large data sets to identify errors in the map.As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into the data processing pipeline.RequirementSome or all of them because we believe intelligent people can pick up whatever they need in a short period of time. You just need to prove that you can: Experience in building modern and scalable REST based microservices using Scala, preferably with Play as MVC framework.2. Expertise with functional programming using SCALA3. Experience in implementing RESTful web services in Scala, Java or similar languages.4. Experience with No SQL and SQL databases.5. Experience in information retrieval and machine learning6. Experience/ knowledge in big data using Scala spark, ML, Kafka, Elastic search will be plus.7.5 to 9 Years experience in the field8.Technology Graduate from a reputed university

we are in the lookout for a seasoned Cloud Data Lead. We are eager to connect with you if you have extensive experience in cloud platforms, data architecture, and leadership!