Hadoop Developer Jobs

Required Qualifications : 3+ years of demonstrated ability with Hive, Python, Spark/Scala, SQL, etc. Google Cloud Platform Experience, Big Query, Cloud Storage, Dataproc, Data Flow, Cloud Composer, Cloud SQL, Pub Sub, Terraform, etc. Experience with Hadoop Ecosystem, Kafka, PCF cloud services Familiar with big data and machine learning tools and platforms Experience with BI tools, such as Alteryx, Data Stage, QlikSense, etc. Design data pipelines and data robots, take a vision and bring it to life Master data engineer; mentors others; works closely with IT architects to set strategy and design projects Provide extensive technical, and strategic advice and guidance to key stakeholders around the data transformation efforts Redesign data flows to prevent recurring data issues Strong analytical and problem-solving skills Possess excellent oral and written communication skills, as well as facilitationand presentation skills, and engaging presentation style. Ability to work as a global team member, as well as independently, in achanging environment and prioritize. Ability to establish and maintain coordinated and effective working relationships with application implementation teams, IT project teams, business customers, and end users. Ability to deliver work within deadlines. Experience with agile/lean methodologies Experience working independently and with minimal supervision Experience with Test Driven Development and Software Craftsmanship Experience with GitHub, Accurev, or other version-control systems Experience with Putty Experience with Datastage Strong Communications skills Ability to illustrate and convey ideas and prototypes effectively with team and partners Presence demonstrating confidence, ability to learn quickly, influence, and shape ideas Key Skills Required - Data Engineer- Python / PySpark / Scala- SQL & Hive- Hadoop Ecosystem- Data Pipeline Design & ETL Development- Google Cloud Platform (BigQuery, Dataproc, Dataflow, Cloud Storage)- Kafka / Streaming Data Processing- Terraform (Infrastructure as Code)- DataStage or Similar ETL Tools- Version Control (GitHub or equivalent)- Agile Methodologies- Strong Analytical & Problem-Solving Skills- Stakeholder Collaboration & CommunicationNice to Have:- Cloud Composer, Cloud SQL, Pub/Sub- BI Tools (Alteryx, QlikSense)- Machine Learning Platform Exposure- Test Driven Development (TDD)- Mentoring & Technical Leadership

Job Title: Hadoop DeveloperLocation: Chennai, IndiaDuration: Permanent positionWork Type: Onsite Role Industry: Financial TechnicalExperience: 05 YearsPlease share the resume at victor@theqctech.comJob Description: 4 Years of relevant experience is mandatory Chennai is a preferred location but anywhere is also fine. Experience extracting data from a variety of sources, and a desire to expand those skills (working knowledge in SQL and Spark is mandatory) Excellent Data Analysis skills. Must be comfortable with querying and analyzing large amounts of data on Hadoop HDFS using Hive and Spark. Preferably candidates must have experience building applications using Google Cloud Platform-related frameworks such as DataFlow/DataProc/PubSub. Excellent Communication Skills to Understand and Pass on Requirements. Pure GCP with the above experience is also ok

we are a staff augmentation organisation. we need candidates having expertise in angularjs

We are looking for an only immediate joiner and experienced Big Data Developer with a strong background in Kafka, PySpark, Python/Scala, Spark, SQL, and the Hadoop ecosystem.The ideal candidate should have over 5 years of experience and be ready to join immediately. This role requires hands-on expertise in big data technologies and the ability to design and implement robust data processing solutions.Key Responsibilities:Design, develop, and maintain scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.Work extensively with the Kafka and Hadoop ecosystem, including HDFS, Hive, and other related technologies.Write efficient SQL queries for data extraction, transformation, and analysis.Implement and manage Kafka streams for real-time data processing.Utilize scheduling tools to automate data workflows and processes.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.Ensure data quality and integrity by implementing robust data validation processes.Optimize existing data processes for performance and scalability.

Salesforce developer possessing 5 to 7 years of experience. Must be willing to work in US shift. This is a full-time remote job.

Job Summary: We are looking for a Salesforce Developer who will play a key role in maximizing the efficacy of the CRM. You will be responsible for the design, development, testing and implementation of customizations, applications, extensions and integrations. You will work with a team of fellow engineers and collaborate with our Sales, Customer Success and Marketing teams to translate business needs into effective and scalable products within the CRM. Responsibilities: Develop, implement and maintain Salesforce customizations, applications, extensions and integrations. Participate in the planning/analysis of business requirements for system changes and enhancements. Collaborate inter-departmentally to identify business needs and translate them into technical solutions. Responsible for developing in Apex, Lightning Web Components, Lightning Design System, and other technologies to build customized solutions. Technical leadership, setting best practices including integration and application development, deployment, testing (unit and systems), and iterative refinement. Seek out ways to use Salesforce to improve processes and productivity, and make recommendations to support an organization scaling at a rapid pace. Should be able to work as individual contributor. Excellent communication and collaboration skills.Skills: Must-Have* - Apex, VF, Lighting Web Components Triggers, SOQL, Test Classes Good-to-Have- Java Script knowledgeQualifications: Bachelors degree or higher in Information Technology, Business, Engineering, or a related field. BE/BTech/MCA Full-Time Education

Experience: 6+ YearsWho should apply for this role?-Good experience with Aurora MYSQL on AWS. (Oracle not preferred).-Proficient in managing the databases.-Good hands-on experience with version upgrades and handling its impact on applications; experience with Data migration.-Minimal experience with Java / Scala.-Strong hands-on experience writing Complex SQL queries, SQL Procedures & Performance tuning.-Constructing infrastructure for efficient ETL processes from various sources and storage systems.-Continuously exploring opportunities to enhance data quality and reliability.-Applying strong programming and problem-solving skills.-Experience with RDBMS and OLAP databases like MySQL, Redshift.-Experience in Big data technologies & AWS.-Immediate joiner.Good to Have:-Willingness to acquire new skills and knowledge.-Possess a product/engineering mindset to drive impactful data solutions.-Experience working in distributed environments with global teams.CTC: As per the Industry standards, negotiable.Appreciate your time invested in us. Thank you!

Our customer is looking for technology head from renowned institutions like IIT, IIM, IISc, NIT & BITS Pilani onlyJob SummaryAs the Technology Head, your responsibility will extend beyond technology to deliver leading-edge Medicare strategy and operations capabilities to our clients. Youll drive the technology roadmap, implement cutting-edge tech, and foster growth in our product line. If you're passionate about solving unprecedented problems, running dev sprints like hackathons, and building innovative data sciencJoin our customer in revolutionizing healthcare with Explainable AI! Our customer mission is to create cutting-edge XAI solutions for health insurance, specifically Medicare Advantage. Our customer is looking for Tech Head to lead for their innovative team.Role: Technology HeadWhat You'll Do: Drive the tech roadmap aligned with business goals Introduce advanced tech for a competitive edge Design adaptable tech stacks Collaborate with clients for compliance Implement Medicare tech solutionsExperience Needed: Educational Background: Bachelors or Masters degree in engineering, computer science, MIS, analytics, or related fields from renowned institutions like IIT, IIM, IISc, NIT & BITS Pilani only Tech Expertise: Proficiency in Cloud (GCP, Azure, AWS), Dot Net, Angular, Python, Spark, SQL, Web APIs, MLOps, AIOps, HTML5, CSS3, Hadoop, Hive, and Spark. IT Architecture Expertise: 8+ years of extensive experience in IT architecture, particularly in healthcare or Medicare systems. Healthcare Technology Proficiency: 8+ years in healthcare technology with a focus on Medicare Advantage Plans.What You'll Bring: Visionary leadership Passion for innovation Strategic thinking Mentorship skills Strong communicationWhy Join Us: Exciting products making a real difference Work with a young-millennial team Open leave policy, flexible hours, WFH, work retreats.

Hadoop Lead RoleExperience 9+ years- Strong architectural experience with Hortonworks, Cloudera Hadoop distributions on Appliance based and on-premise clusters.- Expertise in providing technical solutions for data lakes design and data ingestion in Hadoop.- Expertise in data modelling, data governance and architecture of large size databases.- Expertise in understanding complex data models, large scale data migrations and application development.- Expertise in designing data pipelines solutions for structured, semi-structured and unstructured data in Hadoop.- Expertise in Developing solutions for batch and real time processing data processing in Hadoop.- Hands on experience in query writing using HiveQL, Impala QL and HBase commands.- Able to provide technical guidelines assistance to development team if they face any problems related to environment- Able to coordinate with cloudera team for trouble shooting, OS / network related problems with respective teams.- Proficiency in Cloudera Manager architecture, cloudera cluster environment and cloudera manager.- Proficiency in data ingestion tools like Sqoop, Flume, Kafka, Nifi(HDF), UNIX shells scripting and python- Proficiency in building data warehouse on top of Hadoop in Hive. Defining data models and data mapping from the source to enterprise model.- Proficiency in creating solutions in Spark (Scala/Pyspark) for batch and real time processing.- Proficiency in developing solutions for NoSQL databases like HBase, Cassandra and MongoDB.- Knowledge of Data Security / Governance and Data Lineage handling on Hadoop clusters.- Strong experience on SQL Server and Oracle, MySQL.- Expertise in understanding Java , REST API concepts and troubleshooting java based services.

6+ Years of Industry Work ExperienceExperience extracting data from a variety of sources, and a desire to expand those skills (working knowledge in SQL and Spark is mandatory)Excellent Data Analysis skills. Must be comfortable with querying and analyzing large amount of data on Hadoop HDFS using Hive and Spark.Experience with Object Oriented Programming using Python and its design patterns.Experience handling Unix systems, for optimal usage to host enterprise web applications. Excellent Communication Skills to Understand and Pass on Requirements.

We are looking for 10 Salesforce Developer Posts in india,Service Cloud, LWC, Integration and Apex, with deep knowledge in Triggers,Javascript,Hadoop,Salesforce CRM, Service Cloud, LWC, Integration and Apex and Required Educational Qualification is : Other Bachelor Degree, B.Sc, B.Tech/B.E

Requirement: Strong NoSQL resource who has good knowledge of Java. Development experience is mandatory. Exposure to working knowledge of Druid will be ideal. Someone who has a high level of skill on Hadoop, Hive, etc will also be quickly able to learn Druid. Experience in working with druid data modeling Experience in performance tuning of druid configuration, query optimization Experience in working with Kafka, Pulsar, and Druid for real-time streaming data ingestion Experience in working with cloud platforms and Kubernetes Good knowledge of Java Min 6 months to 1-year experience in Druid is a MUST Experience in Java programming is a MUST Strong NoSQL experience Candidate must have Experience in Hadoop and HiveKey Skill: Java, Druid, Hadoop, Hive, Kubernetes, Job Type: PermanentNo of Vacancy: 03Gender: BothExp. Required: 4-8 YearsSalary: INR 10,00,000 - 20,00,000 PAQualification: Any GraduateCandidate Profile: Min 6 months to 1-year experience in Druid is a MUSTExperience in Java programming is a MUSTStrong NoSQL experienceCandidate must have experience in Hadoop and HiveNotice Period Immediate to 30 DaysIndustry: IT-Software / Software ServicesFunctional Area: IT Software - Application Programming, Maintenance (Software Developer)

SALESFORCE Developer Job Description:Roles and Responsibilities: Support business requirements and deal with all the CRM needs of the client Provide customized solutions using the Salesforce platform Take care of requirement gatherings, produce functional analysis and facilitate customer workshops, etc. To communicate with different project managers, clients, and technicians and ensure efficient participation in all the different phases of development from testing to maintenance. To troubleshoot any bugs or attacks in the system Create various timelines and development goals.Interview Location: Pune (Face to Face Interviews only)Interview Address:2nd floor, above HDFC Bank, Dange Chowk- Hinjewadi, road, near Pandit Petrol Pump, Wakad, Pune, Maharashtra 411033

Job Description 5 years of IT experience with majority of it is in Salesforce development experience Knowledgeable in standard functions/ modules of Salesforce.com: Sales Cloud, Service Cloud, and Financial Services Cloud Proven experience with Force development platform Experience crafting Lightning Apps combining Lightning Design System, Lightning App Builder and Lightning Web Component features. Experience with Salesforce APIs, Apex Triggers, Classes, Callouts, SOQL, Workflow Rules, Approvals, Visual Flow, Process Builder and Platform events. Good understanding of Salesforce design principles, technically scalable data modeling, Governor limits, Force.com development standard methodologies. Proven experience of Salesforce administration and end user security requirements Certified Salesforce Administrator and Certified Salesforce Developer Experience with AWS and other cloud-based development methodologies preferred Proven experience of full Software Development Life Cycle, DevOps, and Continuous Integration/Continuous Development. Experience with large scale system implementation, integration, interfaces, and data conversion Experience in using efficient methodologies (e.g. Agile) and driving development platforms Excellent facilitation, influencing and negotiationskills

xperience working data warehouses, including information retrieval, data mining and machine learning as well as experience in building optimized data intensive applications with modern web technologies (such as NoSQL, MongoDB, SparkML, Tensorflow).EducationProfessional Qualification in Data EngineeringMajorComputer Science/ApplicationKnowledgeExpert Knowledge in the areas Data Engineering, ETL, HadoopSkillHadoop, Spark, Pig, Hive, Python, Java, SQLCertificateDiploma/Certificates in the field of Data EngineeringExperience5-10 Years of relevant experience

Experience and Skills: 3-8 years of relevant experience Expert user of Python & Presto SQL Working experience in, the Hadoop ecosystem, Hive, Kubernetes Usage of various machine learning or statistical libraries, frameworks likePySparkRoles & Responsibilities: Data Engineering and Technical Delivery Prepare data for analysis using Presto SQL or domain-specific tool (example:Omniture forDigital), visualizing the data and executing to specifications Web Scraping using Python to get basic datasets from popular websites (e.g.:LinkedIn) as required, Parsing JSON objects to get the data in tabular format Good knowledge of databases/SQL, relevant tools like R or Python, Omniture(if digital) Experience with frameworks like PySpark to handle large data Shows drive to increase the breadth & depth of tools and systems creatingData schemas, building the pipelines, collecting data, and moving it intostorage. Preparing the data as part of ETL or ELT processes. Stitch the data together with scripting languages and often work with DBAsto construct datastores or data models. Ensure data is available for ready to use and use framework and microservicesto serve up the data Design, build and optimize applications containerization and orchestrationwith Docker andKubernetes Stakeholder Engagement Grasp requirements on call and deliver to specification; Present to SeniorManagement &Leadership Present findings to team lead/managers and to external stakeholders Drive stakeholder engagements by driving complex analytical projectsincluding bottoms-up projects Develop executive presentations with guidance

Excellent verbal and written communication. Should be able to speak confidently throughout the conversationExperience working with customer Business/IT team1. Mandatory to have end-to-end experience working in a Hadoop Data environment (Dev, QA, and Prod) with large data sets (Petabytes).2. Experience with MapReduce code builds and deployments for data sourcing and loads into the Hadoop ecosystem3. Very comfortable with HIVE and HIVEQL4. Comfortable with the broader Hadoop ecosystem HDFS, Yarn, Ambari, Zookeeper, Presto5. Experience working on Apache Spark creating data processing jobs and running them on Spark clusters6. Data migration experience from Hadoop On Prem to HDInsights preferred.7. Knowledge of challenges faced in converting MapReduce jobs to Spark.8. Must have worked on several projects in the Big data spaceHands-on with experience with1. Cloudera Hadoop 5.x2. Hadoop experience: 2-4 years3. Spark experience 2-4 years4. Python and/or Java

Should have Strong expertise of Extraction, Transformation and Loading (ETL) mechanism using Informatica Big Data Management 10.2.X and various Push down mode using Spark, Blaze and Hive execution engine. Should have Strong expertise of Dynamic mapping Use case, Development, Deployment mechanism using Informatica Big Data Management 10.2.X. Should have experience on transforming and loading various Complex data sources types such as Unstructured data sources ,No SQL Data Sources. Should have Strong expertise of Hive Database including Hive DDL, Partition and Hive Query Language. Should have Good Understanding of Hadoop Eco system (HDFS, Spark, Hive). Should have Strong expertise of SQL/PLSQL. Should have Good knowledge on working with Oracle/Sybase/SQL Databases. Should have Good knowledge of Data Lake and Dimensional data Modeling implementation. Should be able to understand the requirements and write Functional Specification Document, Design Document and Mapping Specifications.

Job descriptionExcellent opportunity for freshers/.net/Java developers to learn and build their career in Salesforce.Selected candidates will be trained in Salesforce.Once 03 months training is over, candidates will assist Salesforce Developers on ongoing projects.First salary revision as soon as candidates are allocated on project and successfully start delivering project tasks.Salary revision on completion 1 year and 1.5 years with the organization.Only those candidates will be considered who are ready to sign a service agreement of 02 yearsDesired Candidate Profile0 to 2 years experience in Java/.net/any other programming language.Should have done at least one project during in college/training.Candidate should be able to give demo of the project they have worked on.Hands on experience in designing and developing applications using Java/.net platformsGraduate or Post-GraduateStrong algorithmic skillsAbility to work independently with little supervisionExcellent multi-tasking skillsSelf-motivated with strong team spirit

We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:Experience with big data tools: Hadoop, Spark, Kafka, etc.Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.Experience with AWS cloud services: EC2, EMR, RDS, RedshiftExperience with stream-processing systems: Storm, Spark-Streaming, etc.Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

Job Title: GCP DeveloperLocation: Chennai, IndiaDuration: Permanent positionWork Type: Onsite Role Industry: Financial TechnicalExperience: 05 YearsPlease share the resume at victor@theqctech.comJob Description: 4 Years of relevant experience is mandatory Chennai is a preferred location but anywhere is also fine. Experience extracting data from a variety of sources, and a desire to expand those skills (working knowledge in SQL and Spark is mandatory) Excellent Data Analysis skills. Must be comfortable with querying and analyzing large amounts of data on Hadoop HDFS using Hive and Spark. Preferably candidates must have experience building applications using Google Cloud Platform-related frameworks such as DataFlow/DataProc/PubSub. Excellent Communication Skills to Understand and Pass on Requirements. Pure GCP with the above experience is also ok