Data Engineer

Smart Stream Technologies

Senior Data Engineer:

10+yrs

NP immediate preferred, max 1month

Coimbatore Location (Work From Office Only)

Given Budget 15 to 20LPA

Key Accountabilities:

Design, develop, implement, and support data management solutions.

Develop, maintain, test, and evaluate large-scale data processing solutions (in both batch and real-

time modes).

Ongoing development and support of the data infrastructure (Cloud Platform, Data Lakehouse and

Dashboards)

Provide expertise and practical support in developing data platform solutions.

Implement ETL processes/pipelines, using CI/CD processes.

Support the development and implementation of Solution Design (developing/ system

integration/pre-production/ production /support).

Mandatory Skills:

Solid exposure in end-to-end implementation of data solutions using AWS (including S3, Lambda,

Database Migration Service, Glue , Kinesis , Step Function, Athena), PySpark and SQL.

Experience in spatial, semi-structured, and unstructured data manipulation.

Strong proven experience working as a Data Engineer leading with complex environments.

Good understanding on Data Modelling / Data warehousing. Experienced in Entity Relationship

Modelling.

Experience with designing, building, operating, and deploying scalable data pipelines.

Experience with CI/CD tools: Github Actions or Jenkins

Optimize data pipelines and processes for efficiency, scalability, and cost-effectiveness in the AWS

environment.

Ensure data security, encryption, and compliance with data governance policies and industry

regulations.

Nice to have:

AWS Experience (Sagemaker, EMR, Quicksight)

Data Bricks / Snowflake

Azure

GCP

Experience : 7 - 10 Years

No. of Openings : 3

Education : Professional Degree

Role : Data Engineer

Industry Type : IT-Hardware & Networking / IT-Software / Software Services

Gender : [ Male / Female ]

Job Country : India