Job Title:Data Engineer
Location: Bangalore
Experience: 6+ years
Notice Period : Immediate to 21days
MUST-HAVE TECHNICAL SKILLS
Skill
Skill Depth
Python for Data Pipelines
Independently written ingestion/transformation scripts, including pagination, exception handling, logging, and dataframe-level operations using Pandas, JSON, or GCP SDKs
DBT (Data Build Tool)
Authored and executed DBT models and tests using YAML files and Jinja macros; contributed to CI test configs and schedule integration
GCP (BigQuery, GCS, CloudSQL)
Hands-on experience in at least two of the above tools in pipeline execution ., used BigQuery for SQL transformation and GCS for raw/processed layer segregation
AWS Lambda
Integrated serverless functions to automate trigger points like new file upload, API call chaining or job completion; used boto3 or GCP Pub/Sub hooks
Data Quality & Validation
Developed or plugged-in validation layers for ingestion such as record count matching, null/duplicate flagging, recon table population
Cloud-Native Modeling
Adapted pre-existing logical models to ingestion logic, ensuring correct joins, partitioning strategy, and target-layer conformity (Star/Snowflake)
Version Control & Agile
Participated in Git branching workflows and sprint-based delivery (JIRA or similar); able to push/pull/test with basic conflict resolution