Hadoop Job Vacancies in Gurgaon

Required Skills (must have) : Strong Knowledges/hands-on experience about offers and features of Big data technologies (especially Hadoop, Hortonworks) Strong experience of development using Spark Scala, Java, JavaScript, Nifi, Kafka, Hive, Hbase Strong knowledge of API development Strong knowledge of the java frameworks (Spring MVC, Spring Security) Hands-on knowledge of implementing multi-staged CI / CD with tools like AWS DevOps, Jenkins, BitBucket. Experience in CI / CD integration within the Java / JavaScript ecosystem with build tools like Maven, Grunt, Gulp and other Devops tooling: Jenkins, , GitLab, SonarQube, GERRIT, SBT, Nexus, Docker Experience of AGILE methods (Scrum, Kanban) Active contributions to forum and dev communityRequired Skills (should have) : Knowledges about Elastic Search/Kibana (ELK) knowledge Knowledges about Linux, Unix, Windows environments Strong knowledge on various app monitoring tools. Strong knowledge of web services (WSDL Soap, Restful) Exposure to various Data Visualization tools such as PowerBI, Tableau, and Pentaho etc. Experience with MySQL, NoSql (MongoDB, Redis, DynamoDB) Scripting Skills: Strong scripting (e.g. Python) and automation skills. Operating Systems: Windows and Linux system administration. Monitoring Tools: Experience with system monitoring tools (e.g. Nagios). Problem Solving: Ability to analyze and resolve complex infrastructure resource and application deployment issues

Need Architect/Senior level with below Hadoop SME Requirements 1. Senior/Lead level in Hadoop2. Experience with On-prem Hadoop and/or non-GCP Hadoop distributions.3. Must have experience with Batch and Streaming ETL workflows on non-GCP/on-prem Hadoop4. Experience with Spark and legacy MapReduce apps (scripts and workflows)5. Experience with Core Hadoop migrations to GCP/Dataproc in addition to data lift-shift

xperience working data warehouses, including information retrieval, data mining and machine learning as well as experience in building optimized data intensive applications with modern web technologies (such as NoSQL, MongoDB, SparkML, Tensorflow).EducationProfessional Qualification in Data EngineeringMajorComputer Science/ApplicationKnowledgeExpert Knowledge in the areas Data Engineering, ETL, HadoopSkillHadoop, Spark, Pig, Hive, Python, Java, SQLCertificateDiploma/Certificates in the field of Data EngineeringExperience5-10 Years of relevant experience

Job Openings for 20 Data Engineer Jobs with minimum 3 Years Experience in Gurgaon having Educational qualification of : B.C.A, B.Tech/B.E, M.C.A, M.Tech with Good knowledge in hive,spark,HBase etc. for American Express

Profile - Data Engineer ExecutiveQualification - Graduate With Good Communication SkillExperience - Minimum 1 Year RequiredCandidate Should Have Knowledge of AWS,Spark, Py- Spark, Python, HarkSalary - 24 LPA TO 42 LPA Gender - Male & Female Can ApplyLocation - Pen IndiaDuties & Responsibilities-----Analyze and organize raw data.Build data systems and pipelines.Evaluate business needs and objectives.Interpret trends and patterns.Conduct complex data analysis and report on results.Prepare data for prescriptive and predictive modeling.Build algorithms and prototypes.Only Serious Candidate Apply

Project Role: Application Developer Project Role Description: Design, build and configure applications to meet business process and application requirements. Must have Skills: Data EngineeringKey Responsibilities:Implement the data flowExtend the data platform capability for various data typesDesign the data model according to various type of data sourcesDesign the data flows from the data sources to the destinationsDesign abstracted solutions for data ingestion and processingResearching the appropriate data technology and apply to the organization Technical Experience:Expert Programming experience with Python or Scala, with strong ability to refactor codes in a new environmentExperience with Big Data technologies like Hadoop, Apache Spark, Hive etcStrong Knowledge of Spark Applications lifecycleExperience with working on AWS infrastructure and services like EMR, S3, Redshift, Lambda, etc Knowledge of data structures, algorithms, software design principles and test-driven development Nice to have Experience with containerization technologies-KubernetesProfessional Attributes:Problem solving skills and hands on attitudeEager to never stop learningStrong interpersonal and communication skills Fluent in EnglishA Growth mindset with a high energy for change, a passion for sports and a strong sense of humor.

We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:Experience with big data tools: Hadoop, Spark, Kafka, etc.Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.Experience with AWS cloud services: EC2, EMR, RDS, RedshiftExperience with stream-processing systems: Storm, Spark-Streaming, etc.Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

Experience in automobile domain especially analysing sensor data and IoT is a plus.EducationEngineering graduate in Computers, Masters in Mathematics/Statistics disciplineMajorComputer Engineering/Applications/Mathematics/StatisticsKnowledgeExperience on time series forecasting, unstructured data, deep learning, IoT sensor data and Hadoop platformSkillPython, Hadoop, MatplotLib, QlikView, SQLCertificateDiploma/Certificates in the field of Data EngineeringExperience5-10 Years of relevant experience

should have good knowlege of Python, Hadoop, MatplotLib, QlikView, SQL,Experience on time series forecasting, unstructured data, deep learning, IoT sensor data and Hadoop platformPerform in-depth analyses of business metrics, on behalf of internal customers (Sales, Marketing, Service, Factory etc.) Proficient with data manipulation and analysis tools like Python, Jupyter Notebook and Hadoop platform. Executing end to end projects and result review with internal customers Ensure the quality, stability, and evolution of our reporting tools like an Ad-hoc Dashboard Work with Data Engineer and Korea headquarters' Data Science team to help define the data standards and requirements helping to ensure our systems are running correctly and efficiently Support global training and proper documentation providing the successful on boarding for internal customers Experience in machine learning, statistics, time-series modelling, collaborative filtering and deep learning Experience in solving data-driven problems especially involving large (structured as well as unstructured) datasets. Experience in automobile domain especially analysing sensor data and IoT is a plus.