hadoop lead role
experience – 9+ years
- strong architectural experience with hortonworks, cloudera hadoop distributions on appliance based and on-premise clusters.
- expertise in providing technical solutions for data lakes design and data ingestion in hadoop.
- expertise in data modelling, data governance and architecture of large size databases.
- expertise in understanding complex data models, large scale data migrations and application development.
- expertise in designing data pipelines solutions for structured, semi-structured and unstructured data in hadoop.
- expertise in developing solutions for batch and real time processing data processing in hadoop.
- hands on experience in query writing using hiveql, impala ql and hbase commands.
- able to provide technical guidelines assistance to development team if they face any problems related to environment
- able to coordinate with cloudera team for trouble shooting, os / network related problems with respective teams.
- proficiency in cloudera manager architecture, cloudera cluster environment and cloudera manager.
- proficiency in data ingestion tools like sqoop, flume, kafka, nifi(hdf), unix shells scripting and python
- proficiency in building data warehouse on top of hadoop in hive. defining data models and data mapping from the source
to enterprise model.
- proficiency in creating solutions in spark (scala/pyspark) for batch and real time processing.
- proficiency in developing solutions for nosql databases like hbase, cassandra and mongodb.
- knowledge of data security / governance and data lineage handling on hadoop clusters.
- strong experience on sql server and oracle, mysql.
- expertise in understanding java , rest api concepts and troubleshooting java based services.
Experience
8 - 11 Years
No. of Openings
1
Education
B.E, M.C.A, M.Tech, Any Bachelor Degree
Role
Hadoop Developer
Industry Type
IT-Hardware & Networking / IT-Software / Software Services
Gender
[ Male / Female ]
Job Country
India
Type of Job
Full Time
Work Location Type
Work from Office