Overview
Position: Analyst
Location: Chennai/Hyderabad
Primary Skills
Spark with ML/Mlib
Hadoop (Hive, Pig)
SQL
Secondary Skills
Java
Python
Linux Scripting
Behavioural Skills
Communication skills
Client management - experience
Maturity
Team leading / mentoring
Experience
Total experience - 2 to 3 years
Relevant experience 2+ years
Education: Masters degree in Comp. Science
Job Description
Solid Big-Data Technologies hands on working experience
Strong hands-on experience of programming language like Java/Python/Scala/Spark
Good command and working experience on Hadoop/MapReduce, HDFS, Hive, Hbase, No-Sql Databases
Hands on working experience in analyzing source system data and data flows, working with structured and unstructured data.
Hands on working experience of data processing at scale with event driven systems, message queues (Kafka/Flink/Spark Streaming)
Hands on working experience on any of the data engineering/analytics platform (Hortonworks/Cloudera/MapR), Hortonworks preferred
Experience building data pipelines for structured/unstructured, real-time/batch, events/synchronous/asynchronous using MQ, Kafka, Steam processing
Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
Strong technical, analytical, and problem-solving skills
Excellent written and verbal communication skills