Cloud Data Engineer will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling, Postgres SQL knowledge is a must with Python programming background. The Data Engineer will be responsible for providing design and development solutions for applications in the cloud.
Understand requirements and engage with team to design and deliver projects.
Design and implement data lake house projects within azure.
Design and develop application lifecycle utilizing Microsoft Azure technologies
Participate in Agile ceremonies including daily standups, scrum, retrospectives,demos, code reviews.
Hands on with Python and Postgres SQL development and Azure data pipelines
Engage with team to develop and deliver cross functional products
Key Skills
a. Data Engineering and SQL
b. Python
c. PySpark
d. Azure Data lake and ADF
e. Databricks
f. Postgres database and coding experience
g. CICD
h. Strong communication
Other Responsibilities:
* Document and maintain project artifacts.
* Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
* Complete training as required for Privacy, Code of Conduct etc.
* Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
* Adhere to the company's compliance program.
* Safeguard the company's intellectual property, information, and assets.
* Other duties as assigned.
Minimum Qualifications and Job Requirements:
Required: Azure data engineering associate and databricks data engineering certification
7 years of hands-on experience in designing and developing distributed data pipelines.
5 years of hands-on experience in Azure data service technologies.
Experience with data integration with APIs, Web services, Queues
Experience with Azure DevOps and CI/CD as well as agile tools and processes
Experience
7 - 13 Years
No. of Openings
1
Education
B.C.A, B.Sc, B.E, B.Tech, M.C.A, M.Sc, M.Tech, Any Master Degree
Role
Cloud Engineer
Industry Type
IT-Hardware & Networking / IT-Software / Software Services
Gender
[ Male / Female ]
Job Country
India
Type of Job
Full Time
Work Location Type
Work from Office