role: azure data engineer
experience required: minimum 1+ years of experience as a azure data engineer.
skills required:
●as a data engineer, you will collaborate with a team of business domain experts, data scientists and application developers to identify relevant data for analysis and develop the big data solution.
●analyze business problems and help develop solutions for near real-time stream processing as well as batch processing on the big data platform.
●set up and run hadoop development frameworks.
●explore and learn new technologies for creative business problem solving.
●experience in azure data engineer.
●ability to develop and manage scalable hadoop cluster environments
●experience in big data technologies like hdfs, hadoop, hive, yarn, pig, hbase, sqoop, flume, etc
●working experience in big data services on any cloud based environment.
●experience in spark, scala, kafka, adf, akka and core or advance java and databricks
●experience in nosql technologies like hbase, cassandra, mongodb, cloudera or hortonworks hadoop distribution (good to have)
●familiar with data warehousing concepts, distributed systems, data pipelines and etl
●good communication and interpersonal skills
●minimum 5 years of professional experience with 3 years of big data project experience