Hadoop Developer Jobs in India

we are a staff augmentation organisation. we need candidates having expertise in angularjs

Job Title: Hadoop DeveloperLocation: Chennai, IndiaDuration: Permanent positionWork Type: Onsite Role Industry: Financial TechnicalExperience: 05 YearsPlease share the resume at victor@theqctech.comJob Description: 4 Years of relevant experience is mandatory Chennai is a preferred location but anywhere is also fine. Experience extracting data from a variety of sources, and a desire to expand those skills (working knowledge in SQL and Spark is mandatory) Excellent Data Analysis skills. Must be comfortable with querying and analyzing large amounts of data on Hadoop HDFS using Hive and Spark. Preferably candidates must have experience building applications using Google Cloud Platform-related frameworks such as DataFlow/DataProc/PubSub. Excellent Communication Skills to Understand and Pass on Requirements. Pure GCP with the above experience is also ok

Hadoop Lead RoleExperience 9+ years- Strong architectural experience with Hortonworks, Cloudera Hadoop distributions on Appliance based and on-premise clusters.- Expertise in providing technical solutions for data lakes design and data ingestion in Hadoop.- Expertise in data modelling, data governance and architecture of large size databases.- Expertise in understanding complex data models, large scale data migrations and application development.- Expertise in designing data pipelines solutions for structured, semi-structured and unstructured data in Hadoop.- Expertise in Developing solutions for batch and real time processing data processing in Hadoop.- Hands on experience in query writing using HiveQL, Impala QL and HBase commands.- Able to provide technical guidelines assistance to development team if they face any problems related to environment- Able to coordinate with cloudera team for trouble shooting, OS / network related problems with respective teams.- Proficiency in Cloudera Manager architecture, cloudera cluster environment and cloudera manager.- Proficiency in data ingestion tools like Sqoop, Flume, Kafka, Nifi(HDF), UNIX shells scripting and python- Proficiency in building data warehouse on top of Hadoop in Hive. Defining data models and data mapping from the source to enterprise model.- Proficiency in creating solutions in Spark (Scala/Pyspark) for batch and real time processing.- Proficiency in developing solutions for NoSQL databases like HBase, Cassandra and MongoDB.- Knowledge of Data Security / Governance and Data Lineage handling on Hadoop clusters.- Strong experience on SQL Server and Oracle, MySQL.- Expertise in understanding Java , REST API concepts and troubleshooting java based services.

6+ Years of Industry Work ExperienceExperience extracting data from a variety of sources, and a desire to expand those skills (working knowledge in SQL and Spark is mandatory)Excellent Data Analysis skills. Must be comfortable with querying and analyzing large amount of data on Hadoop HDFS using Hive and Spark.Experience with Object Oriented Programming using Python and its design patterns.Experience handling Unix systems, for optimal usage to host enterprise web applications. Excellent Communication Skills to Understand and Pass on Requirements.

Experience and Skills: 3-8 years of relevant experience Expert user of Python & Presto SQL Working experience in, the Hadoop ecosystem, Hive, Kubernetes Usage of various machine learning or statistical libraries, frameworks likePySparkRoles & Responsibilities: Data Engineering and Technical Delivery Prepare data for analysis using Presto SQL or domain-specific tool (example:Omniture forDigital), visualizing the data and executing to specifications Web Scraping using Python to get basic datasets from popular websites (e.g.:LinkedIn) as required, Parsing JSON objects to get the data in tabular format Good knowledge of databases/SQL, relevant tools like R or Python, Omniture(if digital) Experience with frameworks like PySpark to handle large data Shows drive to increase the breadth & depth of tools and systems creatingData schemas, building the pipelines, collecting data, and moving it intostorage. Preparing the data as part of ETL or ELT processes. Stitch the data together with scripting languages and often work with DBAsto construct datastores or data models. Ensure data is available for ready to use and use framework and microservicesto serve up the data Design, build and optimize applications containerization and orchestrationwith Docker andKubernetes Stakeholder Engagement Grasp requirements on call and deliver to specification; Present to SeniorManagement &Leadership Present findings to team lead/managers and to external stakeholders Drive stakeholder engagements by driving complex analytical projectsincluding bottoms-up projects Develop executive presentations with guidance

xperience working data warehouses, including information retrieval, data mining and machine learning as well as experience in building optimized data intensive applications with modern web technologies (such as NoSQL, MongoDB, SparkML, Tensorflow).EducationProfessional Qualification in Data EngineeringMajorComputer Science/ApplicationKnowledgeExpert Knowledge in the areas Data Engineering, ETL, HadoopSkillHadoop, Spark, Pig, Hive, Python, Java, SQLCertificateDiploma/Certificates in the field of Data EngineeringExperience5-10 Years of relevant experience

Big Data Developer required with experience working in Hadoop in technologies including Spark and Hive. Candidate also needs to haveexperience on CI/CD (Jenkins, Nexus, etc.), and Openshift PaaS implementations, and data pipelines for instance through Control-Mor any other scheduling tool.Candidate will perform the role of senior developer for an established project in the bank where he needs to support existing applicationsas well as work on new requirements from a design and implementation perspectives.Coding System Analysis Mobile Banking Openshift PaaS Relational Databases Apache Spark Control-M GitLab Hadoop Hive Jenkins MAVEN NexusScala Shell Scripting YARN Oracle Scrum/Agile Spring.