Data Engineer

Smart Stream Technologies

senior data engineer:

10+yrs

np – immediate preferred, max 1month

coimbatore location (work from office only)

given budget – 15 to 20lpa

key accountabilities:

design, develop, implement, and support data management solutions.

develop, maintain, test, and evaluate large-scale data processing solutions (in both batch and real-

time modes).

ongoing development and support of the data infrastructure (cloud platform, data lakehouse and

dashboards)

provide expertise and practical support in developing data platform solutions.

implement etl processes/pipelines, using ci/cd processes.

support the development and implementation of solution design (developing/ system

integration/pre-production/ production /support).

mandatory skills:

solid exposure in end-to-end implementation of data solutions using aws (including s3, lambda,

database migration service, glue , kinesis , step function, athena), pyspark and sql.

experience in spatial, semi-structured, and unstructured data manipulation.

strong proven experience working as a data engineer leading with complex environments.

good understanding on data modelling / data warehousing. experienced in entity relationship

modelling.

experience with designing, building, operating, and deploying scalable data pipelines.

experience with ci/cd tools: github actions or jenkins

optimize data pipelines and processes for efficiency, scalability, and cost-effectiveness in the aws

environment.

ensure data security, encryption, and compliance with data governance policies and industry

regulations.

nice to have:

aws experience (sagemaker, emr, quicksight)

data bricks / snowflake

azure

gcp

• Experience

  7 - 10 Years

• No. of Openings

  3

• Education

  Professional Degree

• Role

  Data Engineer

• Industry Type

  IT-Hardware & Networking / IT-Software / Software Services

• Gender

  [ Male / Female ]

• Job Country

  India

• Type of Job

  Full Time

• Work Location Type

  Work from Office