Role: Azure Data Engineer
Experience Required: Minimum 1+ Years of experience as a Azure Data Engineer.
Skills Required:
â—As a Data Engineer, you will collaborate with a team of business domain experts, data scientists and application developers to identify relevant data for analysis and develop the Big Data solution.
â—Analyze business problems and help develop solutions for near real-time stream processing as well as batch processing on the Big Data platform.
â—Set up and run Hadoop development frameworks.
â—Explore and learn new technologies for creative business problem solving.
â—Experience in Azure Data Engineer.
â—Ability to develop and manage scalable Hadoop cluster environments
â—Experience in Big Data technologies like HDFS, Hadoop, Hive, Yarn, Pig, HBase, Sqoop, Flume, etc
â—Working experience in Big Data services on any cloud based environment.
â—Experience in Spark, Scala, Kafka, ADF, Akka and core or advance Java and Databricks
â—Experience in NOSQL technologies like Hbase, Cassandra, MongoDB, Cloudera or Hortonworks Hadoop distribution (good to have)
â—Familiar with data warehousing concepts, distributed systems, data pipelines and ETL
â—Good communication and interpersonal skills
â—Minimum 5 years of professional experience with 3 years of Big Data project experience