Hadoop Job Vacancies in Bangalore

Key Responsibilities:Build and manage data pipelines and ETL processesWork with large datasets using tools like Spark, Hadoop, or SQLEnsure data quality and performance optimizationRequirements:Experience in Python/SQLHands-on with ETL tools and big data technologiesUnderstanding of data warehousing conceptsBrief Summary:Develops scalable data systems to support analytics and business insights.

Design, build, and maintain ETL/ELT data pipelines and data lake solutions to support analytics and AI/ML use cases. Ensure data quality, performance, and reliability across enterprise data platforms.Key ResponsibilitiesPipeline DevelopmentData Lake EngineeringPerformance & OptimizationCollaboration & SupportRequired Skills & Experience 4+ years of experience in data engineering or ETL development. Proficiency in SQL and Python (or Scala/Java) for data transformations. Hands-on with ETL tools (Informatica, Talend, dbt, SSIS, Glue, or similar). Exposure to big data technologies (Hadoop, Spark, Hive, Delta Lake). Familiarity with cloud data platforms (AWS Glue/Redshift, Azure Data Factory/Synapse, GCP Dataflow/BigQuery). Understanding of workflow orchestration (Airflow, Oozie, Prefect, or Temporal).Preferred Knowledge Experience with real-time data pipelines using Kafka, Kinesis, or Pub/Sub. Basic understanding of data warehousing and dimensional modeling. Exposure to containerization and CI/CD pipelines for data engineering. Knowledge of data security practices (masking, encryption, RBAC).Education & Certifications Bachelors degree in Computer Science, IT, or related field.Preferred certifications:o AWS Data Analytics Specialty / Azure Data Engineer Associate / GCP Data Engineer.o dbt or Informatica/Talend certifications.

We are looking for a highly motivated and skilled Data Scientist to join our team. The ideal candidate will have a strong background in data science , machine learning , and statistical analysis, with hands-on experience in python and industry-standards libraries. You will be responsible for deriving actionable insights, building predictive models and effectively communicating findings through data story telling.

we are in the lookout for a seasoned Cloud Data Lead. We are eager to connect with you if you have extensive experience in cloud platforms, data architecture, and leadership!

Objective of the roleResponsible for deploying and supporting the product/CRs at customer environment.Managing the tickets from customer adhering to SLAJob Responsibilities/TasksInstallation of product/solution and its dependencies on serversFollowing up with customer points of contact for various aspects.Integration of product with various external entities and readiness of the solution.End to end system testing before handing over system to customer for user acceptance testing.Driving the UAT with end customer(s) from support perspectiveLaunch and post-go live management of the product, including Monitoring and automation of various jobsSkillsVery good knowledge on Unix and Shell scripting1 to 3 years of experience with Telecom BSS/OSS solution in prior with at least two customers with/without onsite presence.Good knowledge on RDBMS concepts and Oracle QueriesPreferred knowledge on Hadoop/HBase/PostGreSQLExtensive experience of systems development including involvement in all major stages of software development projects.Good Knowledge and appreciation of systems development lifecycles and methodologies.Well established communication, presentation, motivational and inter-personal skills associated with person-management abilities.Thorough understanding, appreciation and analysis of the issues underlying systems development.Experience of the technical aspects of the relevant technologies, software and hardware, to be employed.Prior experience in Telecom sources ETL tool experience is preferred.

We are looking for an only immediate joiner and experienced Big Data Developer with a strong background in Kafka, PySpark, Python/Scala, Spark, SQL, and the Hadoop ecosystem.The ideal candidate should have over 5 years of experience and be ready to join immediately. This role requires hands-on expertise in big data technologies and the ability to design and implement robust data processing solutions.Key Responsibilities:Design, develop, and maintain scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.Work extensively with the Kafka and Hadoop ecosystem, including HDFS, Hive, and other related technologies.Write efficient SQL queries for data extraction, transformation, and analysis.Implement and manage Kafka streams for real-time data processing.Utilize scheduling tools to automate data workflows and processes.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.Ensure data quality and integrity by implementing robust data validation processes.Optimize existing data processes for performance and scalability.

Salesforce developer possessing 5 to 7 years of experience. Must be willing to work in US shift. This is a full-time remote job.

Job Summary: We are looking for a Salesforce Developer who will play a key role in maximizing the efficacy of the CRM. You will be responsible for the design, development, testing and implementation of customizations, applications, extensions and integrations. You will work with a team of fellow engineers and collaborate with our Sales, Customer Success and Marketing teams to translate business needs into effective and scalable products within the CRM. Responsibilities: Develop, implement and maintain Salesforce customizations, applications, extensions and integrations. Participate in the planning/analysis of business requirements for system changes and enhancements. Collaborate inter-departmentally to identify business needs and translate them into technical solutions. Responsible for developing in Apex, Lightning Web Components, Lightning Design System, and other technologies to build customized solutions. Technical leadership, setting best practices including integration and application development, deployment, testing (unit and systems), and iterative refinement. Seek out ways to use Salesforce to improve processes and productivity, and make recommendations to support an organization scaling at a rapid pace. Should be able to work as individual contributor. Excellent communication and collaboration skills.Skills: Must-Have* - Apex, VF, Lighting Web Components Triggers, SOQL, Test Classes Good-to-Have- Java Script knowledgeQualifications: Bachelors degree or higher in Information Technology, Business, Engineering, or a related field. BE/BTech/MCA Full-Time Education

Experience: 6+ YearsWho should apply for this role?-Good experience with Aurora MYSQL on AWS. (Oracle not preferred).-Proficient in managing the databases.-Good hands-on experience with version upgrades and handling its impact on applications; experience with Data migration.-Minimal experience with Java / Scala.-Strong hands-on experience writing Complex SQL queries, SQL Procedures & Performance tuning.-Constructing infrastructure for efficient ETL processes from various sources and storage systems.-Continuously exploring opportunities to enhance data quality and reliability.-Applying strong programming and problem-solving skills.-Experience with RDBMS and OLAP databases like MySQL, Redshift.-Experience in Big data technologies & AWS.-Immediate joiner.Good to Have:-Willingness to acquire new skills and knowledge.-Possess a product/engineering mindset to drive impactful data solutions.-Experience working in distributed environments with global teams.CTC: As per the Industry standards, negotiable.Appreciate your time invested in us. Thank you!

Our customer is looking for technology head from renowned institutions like IIT, IIM, IISc, NIT & BITS Pilani onlyJob SummaryAs the Technology Head, your responsibility will extend beyond technology to deliver leading-edge Medicare strategy and operations capabilities to our clients. Youll drive the technology roadmap, implement cutting-edge tech, and foster growth in our product line. If you're passionate about solving unprecedented problems, running dev sprints like hackathons, and building innovative data sciencJoin our customer in revolutionizing healthcare with Explainable AI! Our customer mission is to create cutting-edge XAI solutions for health insurance, specifically Medicare Advantage. Our customer is looking for Tech Head to lead for their innovative team.Role: Technology HeadWhat You'll Do: Drive the tech roadmap aligned with business goals Introduce advanced tech for a competitive edge Design adaptable tech stacks Collaborate with clients for compliance Implement Medicare tech solutionsExperience Needed: Educational Background: Bachelors or Masters degree in engineering, computer science, MIS, analytics, or related fields from renowned institutions like IIT, IIM, IISc, NIT & BITS Pilani only Tech Expertise: Proficiency in Cloud (GCP, Azure, AWS), Dot Net, Angular, Python, Spark, SQL, Web APIs, MLOps, AIOps, HTML5, CSS3, Hadoop, Hive, and Spark. IT Architecture Expertise: 8+ years of extensive experience in IT architecture, particularly in healthcare or Medicare systems. Healthcare Technology Proficiency: 8+ years in healthcare technology with a focus on Medicare Advantage Plans.What You'll Bring: Visionary leadership Passion for innovation Strategic thinking Mentorship skills Strong communicationWhy Join Us: Exciting products making a real difference Work with a young-millennial team Open leave policy, flexible hours, WFH, work retreats.

Full Stack Development background with Java and JavaScript/CSS/HTML Knowledge of ReactJs/Angular is a plus Big Data Engineer with solid background with the larger Hadoop ecosystem and real-time analytics tools including PySpark/Scala-Spark/Hive/Hadoop CLI/MapReduce/Storm/Kafka/Lambda Architecture Comfortable with using the larger Hadoop eco system Familiar with job scheduling challenges in Hadoop Experienced in creating and submitting Spark jobs Experienced with Kafka/Storm and real-time analytics Core Java and Python/Scala background and their related libraries and frameworks Experienced with Spring Framework and Spring Boot Unix/Linux expertise; comfortable with Linux operating system and Shell Scripting PL/SQL, RDBMS background with Oracle/MySQL Familiarity with ORMs a plus Design, Development, Configuration, Unit and Integration testing of web applications to meet business process and application requirements Familiar with config management/automations tools such as Ansible/Chef/Puppet Comfortable with Microservices, CI/CD, Dockers, and Kubernetes Familiarity with AT&Ts ECO platform is a plus Comfortable tweaking/using Jenkins and deployment orchestration Creating/modifying Dockers and deploying them via Kubernetes

We are looking for 10 Salesforce Developer Posts in india,Service Cloud, LWC, Integration and Apex, with deep knowledge in Triggers,Javascript,Hadoop,Salesforce CRM, Service Cloud, LWC, Integration and Apex and Required Educational Qualification is : Other Bachelor Degree, B.Sc, B.Tech/B.E

Experience in ELKExperience in RDBMSExperience in HadoopExperience in ELK Stack

Job Description 5 years of IT experience with majority of it is in Salesforce development experience Knowledgeable in standard functions/ modules of Salesforce.com: Sales Cloud, Service Cloud, and Financial Services Cloud Proven experience with Force development platform Experience crafting Lightning Apps combining Lightning Design System, Lightning App Builder and Lightning Web Component features. Experience with Salesforce APIs, Apex Triggers, Classes, Callouts, SOQL, Workflow Rules, Approvals, Visual Flow, Process Builder and Platform events. Good understanding of Salesforce design principles, technically scalable data modeling, Governor limits, Force.com development standard methodologies. Proven experience of Salesforce administration and end user security requirements Certified Salesforce Administrator and Certified Salesforce Developer Experience with AWS and other cloud-based development methodologies preferred Proven experience of full Software Development Life Cycle, DevOps, and Continuous Integration/Continuous Development. Experience with large scale system implementation, integration, interfaces, and data conversion Experience in using efficient methodologies (e.g. Agile) and driving development platforms Excellent facilitation, influencing and negotiationskills

Job TitleTeam Lead / Sr. DeveloperLocation : Any Location Skills:Advanced working SQL/NoSQL knowledge and experience working with relational/nonrelational databases.Expert in PythonExperience with big data tools: Hadoop, Spark, Kafka, Nifi etc.Experience with relational SQL (Oracle & PosgreSQL) and NoSQL (HDFS Hive, HBase, Cassandra) databases.Experience with data pipeline and workflow management tools like Airflow, etc.Experience building and optimizing big data data pipelines, architectures and data sets.Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.Strong analytic skills related to working with unstructured datasets.Build processes supporting data transformation, data structures, metadata, dependency and workload management.A successful history of manipulating, processing and extracting value from large disconnected datasets.Working knowledge of message queuing, stream processing, and highly scalable big data data stores.Strong project management and organizational skills.Experience supporting and working with cross-functional teams in a dynamic environment.

Need Architect/Senior level with below Hadoop SME Requirements 1. Senior/Lead level in Hadoop2. Experience with On-prem Hadoop and/or non-GCP Hadoop distributions.3. Must have experience with Batch and Streaming ETL workflows on non-GCP/on-prem Hadoop4. Experience with Spark and legacy MapReduce apps (scripts and workflows)5. Experience with Core Hadoop migrations to GCP/Dataproc in addition to data lift-shift

Excellent verbal and written communication. Should be able to speak confidently throughout the conversationExperience working with customer Business/IT team1. Mandatory to have end-to-end experience working in a Hadoop Data environment (Dev, QA, and Prod) with large data sets (Petabytes).2. Experience with MapReduce code builds and deployments for data sourcing and loads into the Hadoop ecosystem3. Very comfortable with HIVE and HIVEQL4. Comfortable with the broader Hadoop ecosystem HDFS, Yarn, Ambari, Zookeeper, Presto5. Experience working on Apache Spark creating data processing jobs and running them on Spark clusters6. Data migration experience from Hadoop On Prem to HDInsights preferred.7. Knowledge of challenges faced in converting MapReduce jobs to Spark.8. Must have worked on several projects in the Big data spaceHands-on with experience with1. Cloudera Hadoop 5.x2. Hadoop experience: 2-4 years3. Spark experience 2-4 years4. Python and/or Java

We are searching for an accountable, multitalented data engineer to facilitate the operations of our data scientists. The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field. During various aspects of this process, you should collaborate with coworkers to ensure that your approach meets the needs of each project.Job DescriptionBasic concepts of Data Engineering, Hadoop, Data Warehousing, Designing & Implementing large-scale Distributed Data platforms.Building distributed platforms or services.SQL, NoSQL, Query Tuning & Performance Optimization.General advanced Scala or Java or python experience (Design, Code review, build, unit testing, integration & regression testing).Knowledge of Data Analysts and provide the data they need and guide them on the issues.Knowledge of high-level JavaScript concepts like asynchronous programming, closures, promises, data-binding, async-await, etc.DevOps experience in Jenkins, Maven, GitHub, Artifactory/Jfrog, CI/CD, TDD & BDD.Big Data Processing: Hadoop, Sqoop, Spark.Data Streaming: Experience with Kafka and Spark Streaming.Data Validation & Data Quality.Aggregate and clean raw data from different sources.Explore ways to enhance data quality and reliability.Collaborate with data scientists and architects on projects.

DATA ENGINEER (Informatica BDM)Job Location: Dubai & Offshore (Chennai, Hyderabad, Bangalore)Experience: 5+ YearsNotice: 30 days or lessMax CTC: 15K AED per month/ 18LPA for offshoreJOB Description:Should have Strong expertise of Extraction, Transformation and Loading (ETL) mechanism using Informatica Big Data Management 10.2.X and various Push down mode using Spark, Blaze and Hive execution engine. Should have Strong expertise of Dynamic mapping Use case, Development, Deployment mechanism using Informatica Big Data Management 10.2.X. Should have experience on transforming and loading various Complex data source types such as Unstructured data sources ,No SQL Data Sources. Should have Strong expertise of Hive Database including Hive DDL, Partition and Hive Query Language. Should have Good Understanding of Hadoop Eco system (HDFS, Spark, Hive). Should have Strong expertise of SQL/PLSQL. Should have Good knowledge on working with Oracle/Sybase/SQL Databases. Should have Good knowledge of Data Lake and Dimensional data Modelling implementation. Should be able to understand the requirements and write Functional Specification Document, Design Document and Mapping Specifications.