Data Engineer Job Vacancies in Gurgaon

Assist in preparation of initial techno-commercial offer to client preliminary design and the final scope of work, in coordination with the design consultant and UAE engineeringCarry out lifecycle cost analysis for the projects in coordination with OEMs and design consultantAttend client meetings and participate in all technical discussions and negotiations to resolve issues which may ariseWork collaboratively with UAE Projects and O&M teams and India business development teamPrepare cost estimates of the projects for civil/architectural, mechanical, electrical, plumbing and control systemsLiaising with OEMs and other technical groups to bring in best in class cost/energy efficient technologies and innovation Indias and South East Asias technical developmentCarry out technical site due diligence along with design consultantsand UAE team as a part of Merger & Acquisition of projects, for both high side and low side HVAC assetsUndertake environment and social due diligence for both greenfield and M&A projects in collaboration with external consultantsMaintain proper documentation procedures as per applicable ISOstandards and regular uploading of technical/project documents to server seamlesslyTimely completion of technical feasibility, costing, designTimely completion of preliminary design and SoWLife cycle cost analysisTimely resolution of technical issues with clientsTimely coordination with UAE technical teamRealistic estimation of projectsAdopt best in class technologies and innovationSite technical due diligence for M&A projectsStructured documentation procedures and storage of documents Design and EngineeringCarry out detailed design of HVAC projects in coordination withdesign consultant and UAE engineeringReview of PFDs, PIDs, MSDs, Data sheets prepared by theconsultant. Commenting/review on the same for completenessDevelop technical specifications for Equipment/EPC/EPCMPackage. Review of specifications from Consultant / Client / PMC

Hello Everyone,Greetings!We are actively hiring a Data Engineer for our India team! If you or someone in your network is interested, please review the job details below and reach out to me at gaurav.sharma@cxdatalabs.com with you cv.Key Responsibilities:and optimize database data modeling with expertise in Azure Synapse, Azure DataFactory, and Databricks.data migration and modernization efforts within the Enterprise Data Lake.and implement data pipelines, ETL mappings, sessions, and workflows.data transformation, data modeling/mart creation, and scheduling coordination.closely with the Enterprise Information Management Team on data validation strategis, quality analysis, issue resolution, and unit testing.smooth release management and system integration.Qualifications & Skills Required:years of experience in Data Engineering, with a strong domain background in Clinical Research & Biopharmaceutical services.in data platforms and analytics systems, collaborating with Product Owners and stakeholders.in data modeling tools (ER Studio, Erwin) and cloud technologies.understanding of ETL processes, data quality management, and integration strategies.with Agile tools like Jira, Confluence, and Asana.problem-solving skills with the ability to identify areas for improvement and alignbusiness requirements.communication skills to proactively communicate integration changes in advance.If youre interested or have any referrals, please email me or message me directly.Looking forward to connecting!Best Regards,Gaurav Sharma#8802080222HR Operations PartnerCX Data Labs

Level of skills and experience:5 years of hands-on experience in using Python, Spark,Sql.Experienced in AWS Cloud usage and management.Experience with Databricks (Lakehouse, ML, Unity Catalog, MLflow).Experience using various ML models and frameworks such as XGBoost, Lightgbm, Torch.Experience with orchestrators such as Airflow and Kubeflow.Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).Fundamental understanding of Parquet, Delta Lake and other data file formats.Proficiency on an IaC tool such as Terraform, CDK or Cloud Formation.Strong written and verbal English communication skill and proficient in communication with non-technical stakeholderst

Detailed Job Description:We are looking for an Ataccama Admin to join our team and help us manage and maintain our Ataccama data quality and data governance platform. You will be responsible for installing, configuring, and maintaining Ataccama on AWS/Azure platform, as well as developing and implementing data quality rules and policies. You should have a deep understanding of Ataccama architecture and best practices, as well as experience in data management and data governance. Experience in administering Collibra and Immuta is preferred. You should also have experience in managing VMs and Windows and Linux based systems. Pharma experience is preferred.Essential Duties and Responsibilities: Install, configure, and maintain Ataccama Develop and implement data quality rules and policies Monitor and report on data quality metrics Troubleshoot and resolve Ataccama-related issues Stay up-to-date on the latest Ataccama features and best practices Work with cross-functional teams to implement data governance policies and procedures Manage and maintain VMs and Windows and Linux based systems Manage redundancy, backup and recovery plans and processes Strong AWS/Azure experienceQualifications: 4+ years of experience with Ataccama Experience in data management and data governance Experience in administering Collibra and Immuta is preferred Experience in managing VMs and Windows and Linux based systems Experience in Performance Tuning Pharma experience is preferred Strong analytical and problem-solving skills Excellent communication and teamwork skills

3+ years of experience with AWS services including SQS, S3, Step Functions, EFS, Lambda, and OpenSearch.Strong experience in API integrations, including experience working with large-scale API endpoints.Proficiency in PySpark for data processing and parallelism in large-scale ingestion pipelines.Experience with AWS OpenSearch APIs for managing search indices.Terraform expertise for automating and managing cloud infrastructure.Hands-on experience with AWS SageMaker, including working with machine learning models and endpoints.Strong understanding of data flow architectures, document stores, and journal-based systems.Experience in parallelizing data processing workflows to meet strict performance and SLA requirements.Familiarity with AWS tools like CloudWatch for monitoring pipeline performance.Additional Preferred Qualifications:Strong problem-solving and debugging skills in distributed systems.Prior experience in optimizing ingestion pipelines with a focus on cost-efficiency and scalability.Solid understanding of distributed data processing and workflow orchestration in AWS environments.Soft Skills:Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.Ability to work in a fast-paced environment and deliver high-quality results under tight deadlines.Analytical mindset, with a focus on performance optimization and continuous improvement.

Position Overview:We are currently seeking a seasoned Data Engineer to join our dynamic team. The ideal candidate will have a minimum of 4 years of experience in data engineering roles, with a proven track record of delivering high-quality solutions in a fast-paced environment.Responsibilities:Design, build, and maintain scalable data pipelines and infrastructure.Collaborate with cross-functional teams to gather and analyze requirements.Implement best practices for data warehousing, ETL processes, and data integration.Optimize data workflows for performance, reliability, and efficiency.Stay current with emerging technologies and industry trends in data engineering.Qualifications:Bachelor's degree in Computer Science, Engineering, or related field.Minimum of 4 years of professional experience in data engineering.Proficiency in programming languages such as Python, Java, or Scala.Experience with cloud platforms (e.g., AWS, Azure, GCP) and related services.Strong understanding of data modeling, database systems, and SQL.Excellent problem-solving skills and attention to detail.Effective communication and collaboration abilities.

I require a person to assist us with a Python Developer Udemy Course. If the person has the training videos ready, it's the best. If not, the person should be willing to create a course. The person has to create the full course.To Apply please go to GerardYadGG LinkedIn's Page, you will find the website link there, you can apply there. Please apply there to be considered.100% worldwide remote.ID: PL300Thank You.

- SALES & PROJECT ENGINEER FOR INDUSTRIAL PIPELINE...AIR, GAS, FIRE, LUBE & WATER.- As a Sales Engineer you will close new sales opportunities by creating competitive high-quality proposals and also take part in tendering and bidding process.- Sales Engineer key role & responsibilities. - As a Sales Engineer you will close new sales opportunities by creating competitive high-quality proposals and also take part in. -Coordinating with clients, Architects, Vendors to get complete details for the project.- Preparation of the detail BOQ as per the drawings.

Desired candidate profile: Design, develop, and maintain web scraping scripts using Python. Use web scraping libraries like Beautiful Soup, Scrapy, Selenium and other scraping tools to extract data from websites. Write reusable, testable, and efficient code to extract structured and unstructured data. Develop and maintain software documentation for web scraping scripts. Collaborate with other software developers, data scientists, and other stakeholders to plan, design, develop, and launch new web scraping projects. Troubleshoot, debug, and optimize web scraping scripts. Stay up-to-date with the latest industry trends and technologies in automated data collection and cleaning Help maintain code quality and organization of projects Participate in code reviews and ensure that all solutions are aligned with standards. Create automated test cases to ensure the functionality and performance of the code Integration of data storage solutions like SQL/NoSQL databases, message brokers, and data streams for storing and analyzing the scraped data.Experience with Python development and web scraping techniques. Familiarity with web frameworks such as Django and Flask, as well as other technologies like SQL, Git, and Linux, is also required. Strong analytical and problem-solving skills, as well as good communication and teamwork abilities, are also important for the role.

The hire is expected to have good knowledge of Java based technologies as well as fair knowledge of Cloud (GCP) migration.The hire is also expected to have basic GCP understanding and hands on experience in few GCP based services like Dataflow and BigQuery.Additionally, he will also help us in setting up CI/CD pipeline in the project.Following skillset is expected from GCP Java engineer:GCP fundamentals and hands on experience in GCP managed services especially Big Query and Data Flow.Hands on Java8+ experience with understanding of OOPS and other common design patterns. Experience in developing Java based applications (on-premise and on Google Cloud) which are scalable, performant and cost effective.Provisioning new GCP infrastructure using Terraform scripting and building CI/CD in the project.Good problem-solving skills and understanding of microservices based architecture

Data Management PySpark / SparkSQL Data Modeling Python / Scala Adaptable and flexible Agility for quick learning Ability to work well in a team Commitment to quality Strong analytical skillsRoles and Responsibilities:In this role, you need to analyze and solve increasingly complex problems Your day to day interactions is with peers within Accenture You are likely to have some interaction with clients and/or Accenture management You will be given minimal instruction on daily work/tasks and a moderate level of instructions on new assignments You will need to consistently seek and provide meaningful and actionable feedback in all interactions You will be expected to be constantly on the lookout for ways to enhance value for your respective stakeholders/clients Decisions that are made by you will impact your work and may impact the work of others You would be an individual contributor and/or oversee a small work effort and/or team. Please note this role may require you to work in rotational shifts.

We have vacant of 3 data engineer intern Jobs in remote, Artificial Intelligence, Machine Learning, Python, for Freshers Educational Qualification : B.Tech/B.E Skill Artificial Intelligence, Machine Learning, Python etc.,

Production Machine Learning Models with Django API Designs Machine Learning Model Deployment using Django Strong hands-on experience in Python Experience on any one of the Cloud platforms AWS/ Azure/ GCP Experience building custom integrations between cloud-based systems using APIs Excellent communication (verbal and written) skills can communicate complex ideas in simple ways Experience developing and maintaining ML systems built with open source tools Experience developing with containers (Docker) in cloud computing environments is a plus Exposure to machine learning methodology and best practices

should have knowledge on server storage tape library data centre solutions

We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:Experience with big data tools: Hadoop, Spark, Kafka, etc.Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.Experience with AWS cloud services: EC2, EMR, RDS, RedshiftExperience with stream-processing systems: Storm, Spark-Streaming, etc.Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

Job Openings for 20 Data Engineer Jobs with minimum 3 Years Experience in Gurgaon having Educational qualification of : B.C.A, B.Tech/B.E, M.C.A, M.Tech with Good knowledge in hive,spark,HBase etc. for American Express

**Preference will be given to the candidates who can join on or before 1st of October, 2022**You will:Write excellent production code and tests and help others improve in code-reviewsAnalyze high-level requirements to design, document, estimate, and build systemsCoordinate across teams to identify, resolve, mitigate and prevent technical issuesCoach and mentor engineers within the team to develop their skills and abilitiesContinuously improve the team's practices in code-quality, reliability, performance, testing, automation, logging, monitoring, alerting, and build processesYou have:For (Full stack):2 - 10 Years of experienceStrong with DS & AlgorithmsHands on Experience in the Programming languages: JavaScript (React or Angular), Python, SQL.Experience with AWS.For (Backend):2 - 10 years of experienceHands on product development experience using Java/ C++/PythonExperience with AWS,SQL,GITStrong with Data structures and AlgorithmsAdditional nice to have skills/certifications:For Java skill set:Mockito, Grizzly, Netty, VertX, Jersey / JAX-RS, Swagger / Open API, Nginx, Protocol Buffers, Thrift, Aerospike, Redis, Kinesis, Sed, Awk, PerlFor Python skill set: Data Engineering experience, Athena, Lambda, EMR, Spark, Glue, Step Functions, Hadoop, Kinesis, Orc, Parquet, Perl, Awk, RedshiftFor (Data Engineering):2 - 10 years of experienceExperience with object-oriented/object function scripting languages: Python.Experience with AWS cloud services: EC2, RDS, Redshift,S3,Athena, GlueMust be proficient in GIT, Jenkins, CICD (Continuous Integration Continuous Deployment)Experience in big data technologies like Hadoop, Map Reduce, Spark, etcExperience with Amazon Web Services and DockersFor (Geo Team):4 - 10 years of experienceExperience with Big Data technologies like Hadoop, Spark, Map Reduce, Kafka, etcExperience using object-oriented languages (Java, Python)Experience in working with different AWS technologies.Experience in software

Profile - Data Engineer ExecutiveQualification - Graduate With Good Communication SkillExperience - Minimum 1 Year RequiredCandidate Should Have Knowledge of AWS,Spark, Py- Spark, Python, HarkSalary - 24 LPA TO 42 LPA Gender - Male & Female Can ApplyLocation - Pen IndiaDuties & Responsibilities-----Analyze and organize raw data.Build data systems and pipelines.Evaluate business needs and objectives.Interpret trends and patterns.Conduct complex data analysis and report on results.Prepare data for prescriptive and predictive modeling.Build algorithms and prototypes.Only Serious Candidate Apply

Good experience in computer programming languages such as: Python & SQL Minimum 3 years of working experience in Python and Python Frameworks (Flask/Django). Familiarity with concepts of MVC, Mocking, ORM, and RESTful. Solid understanding of object-oriented programming. Experience working with design architecture. Familiarity with some ORM (Object Relational Mapper) libraries. Sound knowledge of Database administration like: Managing MySQL Server, MSSQL Server. Advanced working SQL knowledge and experience working with relational databases, as wellworking familiarity with a variety of databases. Knowledge of NoSQL Databases (MongoDB, DynamoDB) is good to have. Strong knowledge on JavaScript or JQuery. Knowledge of other languages OR big data tools (Hive, Spark) is a plus. Ability to work with AWS services like Lambda, Kinesis, SQS, SNS etc., is a plus. Certificationin cloud platforms like Azure, AWS, and Google will be considered a very good asset. Strong verbal and written communication skills with ability to communicate effectively,articulate results and issues to internal and client teams.

I require a person to assist us with a Java Udemy Course. If the person has the training videos ready, it's the best. If not, the person should be willing to create a course. The person has to create the full course.To Apply please go to GerardYadGG LinkedIn's Page, you will find the website link there, you can apply there. Please apply there to be considered.100% worldwide remote.ID PI 206

I require a person to assist us with Java Developer Udemy Course. If the person has the training videos ready, it's the best. If not, the person should be willing to create a course. The person has to create the full course.To Apply please go to GerardYadGG LinkedIn's Page, you will find the website link there, you can apply there. Please apply there to be considered.100% worldwide remote.ID PI 203

I require a person to assist us with a Data Science Udemy Course. If the person has the training videos ready, it's the best. If not, the person should be willing to create a course. The person has to create the full course.To Apply please go to GerardYadGG LinkedIn's Page, you will find the website link there, you can apply there. Please apply there to be considered.100% worldwide remote.ID PI 201

We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:Experience with big data tools: Hadoop, Spark, Kafka, etc.Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.Experience with AWS cloud services: EC2, EMR, RDS, RedshiftExperience with stream-processing systems: Storm, Spark-Streaming, etc.Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.