Array ( [0] => big-data [1] => chennai ) Big Data Jobs in Chennai,Big Data Job Vacancies in Chennai Tamil Nadu
22

Big Data Job Vacancies in Chennai

filter
  • Location
  • Role
  • Functional Area
  • Qualification
  • Experience
  • Employer Type
  • Fresher
  • Female
  • Chennai
Data Cleansing Big Data Technologies Data Transformation Programming Data Warehousing
We are seeking a motivated and enthusiastic Data Processing Engineer to join our team. This role is perfect for recent graduates or individuals looking to start their career in data processing.As a Data Processing Engineer, you will be responsible for handling and organizing data efficiently. Your key responsibilities will include:- **Data Entry**: Accurately input data into our systems while ensuring all information is correct and up to date.- **Data Quality Assurance**: Review and validate data to identify any errors or inconsistencies, and fix them promptly.- **Data Maintenance**: Regularly update and maintain databases to keep them organized and accessible for team members.- **Reporting**: Generate basic reports from the data you process, helping the team make informed decisions.To be successful in this role, you should possess strong attention to detail and the ability to work independently from home. You must be comfortable using computers and familiar with basic data processing tools. Strong communication skills are essential to collaborate effectively with team members. Having a proactive approach to problem-solving will also be important as you work through data challenges.We welcome applications from females who have completed their 10th grade education and are eager to begin a full-time position in data processing. This is a fantastic opportunity to learn, grow, and launch your career in the field of data.
View all details
  • 4 - 6 yrs
  • 7.0 Lac/Yr
  • Chennai
Data Governance Data Lake Data Loading Data Pipelines Data Transformation Query Optimization Performance Tuning Data Architecture Data Warehousing SQL ETL Scripting Data Integration Data Migration Data Modeling Database Design Snowflake Python Big Data Cloud Computing
We are looking for Certified Snow Flake Developer with 4 to 6 year experience in Chennai.Strong knowledge of SQLExperience with Snowflake architectureUnderstanding of Data Warehousing conceptsExperience with ETL / ELT toolsKnowledge of Cloud Platforms (AWS, Azure, GCP)Programming knowledge in Python, Java, or Scala
View all details

Big Data Engineer (Spark and Scala)

E2E Infoware Management Services

Scala Spark Pyspark
Role: Bigdata Developer - Scala SparkExp: 5+ YrsMode of Work: WFO All 5 daysLocation: Chennai/Bangalore/PuneInterview: Any one Level F2FJob Description: Total IT / development experience of 3+ years Experience in Spark (Scala-Spark ) developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB Deep knowledge of Scala-Spark libraries to develop and debug complex data engineering challenges Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies Exposure to deploying on Cloud platforms At least 2 years of development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark-Scala At least 2 years of development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS At least 2 years of developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, Unix Shell Scripting, TDD, CI/CD, Change Management to support DevOps
View all details

Big Data Lead

Hexaware Technologies

Snowflake Python SQL
Must have 4-6 years of experience in Data warehouse, ETL, BI projects Must have atleast 4+ years of experience in Snowflake Expertise in Snowflake architecture is must. Must have atleast 3+ years of experience and strong hold in Python/PySpark Must have experience implementing complex stored Procedures and standard DWH and ETL concepts Proficient in Oracle database, complex PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot Good to have experience with AWS services and creating DevOps templates for various AWS services. Experience in using Github, Jenkins Good communication and Analytical skills Snowflake certification is desirable
View all details

Get Personalized Job Matches

Based on your experience, skills, interests, and career goals to help you find the most relevant opportunities faster. Register Now!
  • 2 - 6 yrs
  • 6.5 Lac/Yr
  • Bangalore National Highway Chennai
Data Warehousing Apache Data Integration Data Management SQL ETL Tool Hadoop AWS Big Data Python Java Java-script React Js
Invitation for B2B Partnerships: Seeking Software Development Support! We are looking to collaborate with companies that can provide 10 skilled Data Engineers to support our data engineering requirements pipeline for Euoropean clients on a contract basis.Requirements:Expertise in data engineering, including data processing and ETL.Proficiency in SQL and NoSQL databases.Experience with Hadoop or Spark.Experience in AWS or Azure.Snowflake is an added advantage.If your company is equipped to provide top-notch Data Engineers, we invite you to submit your proposal with terms and conditions.Please contact us by email or Whatsapprakanalytics@gmail.com (or) 9900173022
View all details

Machine Learning Engineer - Freshers

Thirumoolar IT Solutions

  • 0 - 1 yrs
  • 3.0 Lac/Yr
  • Chennai
Core Java Python Deep Learning Statistics Big Data
Thirumoolar IT Solutions is currently hiring for the position of Machine Learning Engineer - Freshers. This role is suitable for candidates looking to start their careers in machine learning and is based in Tamil Nadu, with a preference for work-from-home arrangements.Job ResponsibilitiesCollaborate with data scientists to identify and understand business problems suitable for machine learning solutions.Preprocess and clean data for model training, addressing missing values and performing feature engineering.Implement and train machine learning models using Python libraries such as scikit-learn, TensorFlow, or PyTorch.Optimize model performance through hyperparameter tuning and feature selection.Develop unit and integration tests to ensure the robustness of models.Deploy trained models to production environments using tools like Docker and Kubernetes.Monitor model performance in production and implement strategies for continuous improvement.Document code, models, and processes for maintainability and reproducibility.RequirementsBachelor's or Master's degree in Computer Science, Statistics, Mathematics, or a related field.Strong programming skills in Python and familiarity with machine learning libraries.Understanding of machine learning algorithms and techniques, including supervised and unsupervised learning.Preferred LocationCandidates based in Chennai, Tamil Nadu, or those willing to work from home are encouraged to apply.
View all details

Big Data & Cloud Senior Architect

Brid Tech Solutions Private Limited

Big Data Cloud Architect Senior Cloud Cloud Engineer Work From Home Walk in
Job DescriptionThe Big Data/Analytics Solution Architect is responsible for understanding emerging and evolving end user usage models and requirements in Big Data and Analytics, documenting those usage models and business, technical and user requirements and designing a solutions architecture to meet those requirements and specifying an implementation HW and SW solution stack. Solution architects document the solution architectures and solution requirements and, when needed, define end user proofs of concept to test the architectures, usage models and corresponding Intel technologies in testbed or real end user environments. They also work with end users and ecosystem partners to deploy those solutions in early adopter production environments. A strong candidate will have:Experience in Requirements Engineering, Solution Architecture, Design, Development and DeploymentA broad set of technical skills and knowledge across hardware, software, systems and solutions development and a across more than one technical domain.Demonstrated experience in real world IT or other solutions environments including creating (on your own or with a team) a product or IT solution in the area of Big Data/AnalyticsStrong communication skills including representing your company in industry standards organizations or industry technical forums or events in Cloud SecurityStrong technical team leadership, mentorship and collaboration.Ability to develop technical relationships with end-users, ISVs, OEMs and Intel platform architects and Proof-Of-Concept engineers.
View all details

Azure Data ENgineer

Prevaj Consultants Pvt Ltd

  • 5 - 10 yrs
  • 10.0 Lac/Yr
  • Chennai
Big Data HDFS Hadoop Hive Yarn Pig HBase Sqoop Flume Azure Work From Home
Role: Azure Data EngineerExperience Required: Minimum 1+ Years of experience as a Azure Data Engineer.Skills Required:As a Data Engineer, you will collaborate with a team of business domain experts, data scientists and application developers to identify relevant data for analysis and develop the Big Data solution.Analyze business problems and help develop solutions for near real-time stream processing as well as batch processing on the Big Data platform.Set up and run Hadoop development frameworks.Explore and learn new technologies for creative business problem solving.Experience in Azure Data Engineer.Ability to develop and manage scalable Hadoop cluster environmentsExperience in Big Data technologies like HDFS, Hadoop, Hive, Yarn, Pig, HBase, Sqoop, Flume, etcWorking experience in Big Data services on any cloud based environment.Experience in Spark, Scala, Kafka, ADF, Akka and core or advance Java and DatabricksExperience in NOSQL technologies like Hbase, Cassandra, MongoDB, Cloudera or Hortonworks Hadoop distribution (good to have)Familiar with data warehousing concepts, distributed systems, data pipelines and ETLGood communication and interpersonal skillsMinimum 5 years of professional experience with 3 years of Big Data project experience
View all details

Senior Java Developer

Speakiee Corporation

  • 5 - 10 yrs
  • Chennai
Core Java OOAD Test Driven Development Version Control GIT TFS Jenkins Debugging Profiling HTML5 Big Data Java
Core Responsibilities Write well designed, testable, efficient code Ability to prioritize and multi-task Resolve technical issues through debugging, research and investigation A team player who is also effective working independently Trouble shooting Working directly with developers and product managers Requirements gathering Build prototypes at tech scoping stage of projects Working with the sales and support teams to build the interface with focus on usability features Explain technologies and solutions to technical and non-technical stakeholders Being open. Being able to accept and give positive critique. Its about delivering software and solutions to the customer, not about egos.Skills & Requirements Proven problem solving and analytical skills, with the ability to drive through technical challenges. Excellent communication and written skills, with an emphasis towards collaborative teamwork. Continually updates technology skillsEssential Technical Skills Java Strong OOA/OOD Test driven development Version control such as Subversion Debugging, profiling, heap analysis Continuous integration with tools such as Jenkins, ANTAdded AdvantageEclipse IDE Android SDK iOS SDKXCode IDE SQLMySQL, Oracle, TeradataJavaScript, HTML5, Swing and Java FX, Hadoop, Big Data, Spark, Storm
View all details

ORACLE EBS - SENIOR ARCHITECT

Effort HR business solution

Architect Implementation SCM CRM Vcp Oracle Big Data Machine Learning p2p OTC Walk in
Job Description:The senior architect would lead and support enterprise Oracle product and technologylandscape, with end-to-end responsibility from solution architecting to standards compliance.Roles and Responsibilities:- RICEW components: Design, Development, Conversion, Customization, Interfacing andImplementation of Oracle Applications using Oracle SQL/PLSQL, Oracle Reports, FORMSand BI Publisher- UNIX Shell Scripting, middle ware tools (SOA, Boomi)- Designing and developing Oracle object such as Tables, Views, Indexes, Partitions,Stored Procedures & Functions in PL/SQL, Packages, Materialized Views, Dynamic SQLand Analytical functions, WebADI, etc.- Architecting, designing & developing third party interfaces or webservices to supportEDI, bank, portals, etc.- Resolve business process gaps in standard Oracle with simple and effective solutionswith minimal customizations.- Present complex issues to a variety of audiences: technical, non-technical and executivepersonnel.- To work effectively in Onshore-offshore modelsRequired Skills:- Must have 4-5 years of experience with solution architecting, implementation and/orintegration experience in various Oracle EBS core and peripheral products:- SCM (OM, PO, Inventory, BOM, WIP, Global Pricing, Configurator, ASCP, Quoting,iProcurement, MSCA, Quality, Shipping)- Finance (AP, AR, GL, FA, CM, iReceivables, iSupplier)- CRM (OIC, Territory Manager, Install Base, Depot Repair, Teleservices, Collections)- VCP (Demantra, ASCP, etc.).- MDM.- BI, Oracle Big Data.- Oracle R Technologies.- Machine learning for Oracle R.- Proficiency in Oracle E-business suite R12- Strong understanding on business flows: Procure to pay (P2P), order to cash (OTC), cashto cash (CTC), hire to retire (HTR), etc.- Must have demonstrated knowledge/experience on Oracle application integrations,APIs, various module dependencies, feature set dependencies, etc.- Must have designed solutions within and outside of Oracle,
View all details

Data Engineer

Aalom Info Solutions

  • 2 - 7 yrs
  • 10.0 Lac/Yr
  • Chennai
ADF AWS Big Data SQL Power BI Python Data Engineer
*Project ResponsibilityCreate and maintain an optimal data pipeline architecture.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big datatechnologies.Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.Work with data and analytics experts to strive for greater functionality in our data systems*QualificationBachelors degree in Computer Science, Information Systems or equivalent education or work Experience2-6 years of experience in a Data Engineer role with expertise in Cloud, python, ETL, SQL, Power BIExperience in Power BI, Dax and M queries will be an added advantage.Experience with big data tools: Hadoop, Spark, Kafka, etc.Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.Experience with AWS cloud services: EC2, EMR, RDS, RedshiftExperience with stream-processing systems: Storm, Spark-Streaming, etc.Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
View all details
Python SCALA JAVA AWS - EMR Hadoop Spark Kafka SQL NoSQL Data Architecture Data Structures Storm Flink
ResponsibilitiesCreate and maintain optimal data pipeline architectureAssemble large, complex data sets that meet functional / non-functional business requirements.Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Open Source and AWS big data technologiesBuild analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.Work with data and analytics experts to strive for greater functionality in our data systems.QualificationsExperience building and optimizing big data pipelines, architectures and datasets.Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.Experience interacting with customers and various stakeholders.Strong analytical skills related to working with unstructured datasets.Build processes supporting data transformation, data structures, metadata, dependency and workload management.Working knowledge of message queuing, stream processing, and highly scalable big data lakes.Strong project management and organizational skills.Experience supporting and working with cross-functional teams in a dynamic environment.They should also have experience using the following software/tools:Big data technologies: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL databases, including Postgres and Cassandra.Data pipeline and workflow management tools: Airflow, NiFi etc.Cloud services: AWS - EMR, RDS, Redshift, Glue. Azure - Databricks, Data Factory. GCP - Dataproc, Pub/SubStream-processing systems: Storm, Spark Streaming, Flink etc.
View all details

DATA ENGINEER (Informatica BDM)

KGP Manpower Consulting Pvt Ltd

Informatica Big Data Management SAS-Statistical Analysis System ETL Hadoop DATA ENGINEER Azure JSON XML Scala Spark Github DevOps Data Miration
DATA ENGINEER (Informatica BDM)Job Location: Dubai & Offshore (Chennai, Hyderabad, Bangalore)Experience: 5+ YearsNotice: 30 days or lessMax CTC: 15K AED per month/ 18LPA for offshoreJOB Description:Should have Strong expertise of Extraction, Transformation and Loading (ETL) mechanism using Informatica Big Data Management 10.2.X and various Push down mode using Spark, Blaze and Hive execution engine. Should have Strong expertise of Dynamic mapping Use case, Development, Deployment mechanism using Informatica Big Data Management 10.2.X. Should have experience on transforming and loading various Complex data source types such as Unstructured data sources ,No SQL Data Sources. Should have Strong expertise of Hive Database including Hive DDL, Partition and Hive Query Language. Should have Good Understanding of Hadoop Eco system (HDFS, Spark, Hive). Should have Strong expertise of SQL/PLSQL. Should have Good knowledge on working with Oracle/Sybase/SQL Databases. Should have Good knowledge of Data Lake and Dimensional data Modelling implementation. Should be able to understand the requirements and write Functional Specification Document, Design Document and Mapping Specifications.
View all details

Scala Developer

Sight Spectrum

Scala Algorithms Data Structures Scala Developer Big Data Hive Java Software Development Work From Home
OUR REQUIREMENTS Professional experience as a Scala developer Knowledge of Akka, event driven systems and functional programming Experience with working with large code-bases Good spoken and written English communication skills, ability to express ideas clearly Experience or strong interest in the financial industry Experience building scalable, distributed applications in Scala and Java Strong understanding of Algorithms and Data Structures Experience in developing software in an agile environment Interest in the latest programming trends such as functional and reactive programming Knowledge of relational and non-relational database systems Experience in implementation of APIs for integration with internal and external systems Strong problem-solving skills & ability to learn in a fast paced environment.
View all details

C++ Programmer

Pearlcon Technologies

  • 2 - 8 yrs
  • 12.0 Lac/Yr
  • Chennai
C++ Developer Telecom Domain Multithreading C++ Boost STL Data Structures Socket Programming TCP Big Data Debugging Compiler Templates CPP
Consulting with internal stakeholders to determine the scope of software development projects. Collaborating with the software development team on application design and development. Developing software and overseeing the deployment of applications across platforms. Performing diagnostic tests and debugging procedures. Creating end-user application feedback channels. Optimizing software by performing maintenance, updates, and upgrades. Documenting processes and maintaining software development records. Keeping up to date with C++ standards and advancements in application development. A minimum of 3 years' experience as a C++ software developer. Current knowledge of C++ standards and specifications. Extensive experience in deploying software across a variety of platforms and operating systems. Superb analytical and problem-solving skills. Excellent collaboration and communication skills. Great organizational and time management skills. Should have in telecom domain is an added advantage.
View all details

Backend Developer C# - Remote

Smart Apartment Data

C# .Net Backend Developer Backend Big Data API Work From Home
Are you looking to work with the latest technologies in Big Data for an award-winning software company? Smart Apartment Data is an employee-rated five-star company and a winner of the Houston Best & Brightest Companies to Work for , we place strong emphasis on offering a fun work-environment, generous pay with bonuses, individual growth, and a healthy work-life balance. Who are we?Founded 16 years ago, Smart is now the premier data analytics platform for the housing industry in the United States. We are utilizing Big Data to offer market intelligence real estate brokers, investors and analysts.Who are we looking for?We are looking for someone fluent in English with the ability to express their creativity and talents. You will work on interesting projects with experienced developers using the AWS cloud.Sneak peak of projects:*Big Data Orchestration*Data Warehousing in AWS*API Design with C# 9We are looking for someone who:*Fluent in English (C1 advanced)*Ability to work flexible hours*2+ years of experience as a C# developer*Good understanding of REST API design methodologies using C#We offer:*Location Independent / 100% Remote*Flexible working hours*Competitive base salary with guaranteed annual bonus*Work with latest and cutting-edge technologies*Training and mentoring by senior developersThink you fit the description?Apply as soon as possible and send an email and CV
View all details

C++ Developer

Quench Techno Valley

  • 2 - 5 yrs
  • Chennai
Multithreading C++ Boost STL Data Structures Socket Programming TCP Big Data Debugging Compiler Templates CPP
Primary Skill: C++, Multithreading Location: Chennai Experience: 2-5 years Notice period: Immediately to Dec Joiners Salary- based on Experience it changes Work From office
View all details

C Developer

Mirror Institute For Embedded Technology

  • 0 - 2 yrs
  • 2.5 Lac/Yr
  • Vadapalani Chennai
C Language Multithreading C++ Boost STL Data Structures Socket Programming TCP Big Data Debugging Compiler Templates CPP
Job Role: C Trainer jobs in chennai Eligibility: BE / B.Tech / ME/ M.Tech / BCA/ MCA /Bsc /Msc Only Under Anna University Tamilnadu First graduate preferableBranch : Only Computer science / Information Technology (Strictly we follow) Mark: 68 % and above and minimum 60 % in 10 th and 12 th.Job responsibility: Taking Class for engineering fresher and also provide much practical exposure on C Programming
View all details

Data Engineer

Harishree Recruitment Services Pvt Ltd

  • 4 - 10 yrs
  • 25.0 Lac/Yr
  • Chennai
Big Data Kafka Spark Beam EC2 Ecosystems SAS-Statistical Analysis System ETL Hadoop DATA ENGINEER Azure JSON XML Scala Github DevOps Data Miration Work From Home Walk in
Position:- Junior & Senior Data Engineer.Role - Data EngineerExp:- Jr.:- 4+ Years & Sr.: 7+ YearsSalary:- Jr. :- upto 20LPA & Sr.:- Upto 25 LPALocation:- WFHJob Description 7+ years of experience in IT programming, application/product development. At least 5 years' experience working in any of the Bigdata cloud ecosystems likeAWS/GCP Strong in SQL/RDBMS and any of the programming languages like Java/Python/Scala. Experience with one or more of the big data tools like Hadoop, Kafka, Spark, Beam etc. Good experience with AWS services like EC2, EMR, RedNote:- notice period max 30 Days ca apply
View all details
Big Data Spark Scala AWS Python Tech Lead Technical Lead Java
Position - Technical LeadExperience level - 7+ years Job location - Chennai / BangaloreRole DescriptionTheDataTeam is looking for a Technical Lead - Big Data who will be responsible for the following:To lead the technical discussion during the requirements gathering phaseCoordinate with Solution Architect to arrive at a technical solution for the problem statement.Lead the team for task estimation, planning, tracking and resolving technical blocker issues.Proactively keep the Project Managers and Client stakeholders updatedShould prepare Low Level Design DocumentShould participate in preparing High Level Design DocumentManage CI/CD PipelinesPeriodic Code Review and Code mergeManage cloud deploymentsTrack and help the client/vendor to complete the UAT Key skills:Should have minimum 7+ years of IT experience; at least 2-3 years of exp on BigData Ecosystem Should have good knowledge on Spark, NoSQL ,Oozie/Airflow,Scala/JavaCore Java or Python Skills is mustExperience on AWSExperience on developing complex data processing pipelinesHands on experience on either one of the Hadoop Distributions MapR, Cloudera and or Cloud (AWS EMR, Azure HD Insights, Qubole, etc)Got to have practical knowledge of Data Driven Approaches, Data SecurityApproachesWorked as Technical Lead for a minimum of 3 or more projects.Experience on performance tuning of Spark Jobs Assist in documenting requirements and resolving technical clarification with clientExperience on CI/CD DeploymentsGood knowledge on Linux and Bash commandsExperience on documenting LLD Documents
View all details
  • 0 - 1 yrs
  • 6.0 Lac/Yr
  • Perungudi Chennai
Python Big Data C++ MySQL Java Developer Algorithms Data Structures
As an AI Researcher, you will be responsible for conducting cutting-edge research in the field of Artificial Intelligence (AI). You will work on advancing the state-of-the-art in AI algorithms, methodologies, and technologies to solve complex problems and drive innovation in various domains.
View all details

Data Engineer

United Technology

  • 1 - 3 yrs
  • 4.0 Lac/Yr
  • Chennai
Data Integration Data Engineer Hadoop ETL SQL Informatica Apache AWS Big Data Python
We are looking Data Engineer with 1 to 3 years experience in Chennai.Immediate joiners preferred
View all details
  • 0 - 1 yrs
  • 1.5 Lac/Yr
  • Chennai
Python Big Data Technologies Statistical Modeling Deep Learning DATA WRA DATA WRANGLING
We are looking Any Degree Graduate Freshers for Data Science in Chennai.Stipend: Based on students performance during the internship. Minimum 3K. Depending upon performance can go upto 5K- Salary package: After internship the candidate will get the salary of 1.5LPA to 2LPA will be provided.
View all details
View More Jobs