job title:data engineer
location: bangalore
experience: 6+ years
notice period : immediate to 21days
must-have technical skills
skill
skill depth
python for data pipelines
independently written ingestion/transformation scripts, including pagination, exception handling, logging, and dataframe-level operations using pandas, json, or gcp sdks
dbt (data build tool)
authored and executed dbt models and tests using yaml files and jinja macros; contributed to ci test configs and schedule integration
gcp (bigquery, gcs, cloudsql)
hands-on experience in at least two of the above tools in pipeline execution ., used bigquery for sql transformation and gcs for raw/processed layer segregation
aws lambda
integrated serverless functions to automate trigger points like new file upload, api call chaining or job completion; used boto3 or gcp pub/sub hooks
data quality & validation
developed or plugged-in validation layers for ingestion such as record count matching, null/duplicate flagging, recon table population
cloud-native modeling
adapted pre-existing logical models to ingestion logic, ensuring correct joins, partitioning strategy, and target-layer conformity (star/snowflake)
version control & agile
participated in git branching workflows and sprint-based delivery (jira or similar); able to push/pull/test with basic conflict resolution