SCALA Job Vacancies in Chennai

Required Qualifications : 3+ years of demonstrated ability with Hive, Python, Spark/Scala, SQL, etc. Google Cloud Platform Experience, Big Query, Cloud Storage, Dataproc, Data Flow, Cloud Composer, Cloud SQL, Pub Sub, Terraform, etc. Experience with Hadoop Ecosystem, Kafka, PCF cloud services Familiar with big data and machine learning tools and platforms Experience with BI tools, such as Alteryx, Data Stage, QlikSense, etc. Design data pipelines and data robots, take a vision and bring it to life Master data engineer; mentors others; works closely with IT architects to set strategy and design projects Provide extensive technical, and strategic advice and guidance to key stakeholders around the data transformation efforts Redesign data flows to prevent recurring data issues Strong analytical and problem-solving skills Possess excellent oral and written communication skills, as well as facilitationand presentation skills, and engaging presentation style. Ability to work as a global team member, as well as independently, in achanging environment and prioritize. Ability to establish and maintain coordinated and effective working relationships with application implementation teams, IT project teams, business customers, and end users. Ability to deliver work within deadlines. Experience with agile/lean methodologies Experience working independently and with minimal supervision Experience with Test Driven Development and Software Craftsmanship Experience with GitHub, Accurev, or other version-control systems Experience with Putty Experience with Datastage Strong Communications skills Ability to illustrate and convey ideas and prototypes effectively with team and partners Presence demonstrating confidence, ability to learn quickly, influence, and shape ideas Key Skills Required - Data Engineer- Python / PySpark / Scala- SQL & Hive- Hadoop Ecosystem- Data Pipeline Design & ETL Development- Google Cloud Platform (BigQuery, Dataproc, Dataflow, Cloud Storage)- Kafka / Streaming Data Processing- Terraform (Infrastructure as Code)- DataStage or Similar ETL Tools- Version Control (GitHub or equivalent)- Agile Methodologies- Strong Analytical & Problem-Solving Skills- Stakeholder Collaboration & CommunicationNice to Have:- Cloud Composer, Cloud SQL, Pub/Sub- BI Tools (Alteryx, QlikSense)- Machine Learning Platform Exposure- Test Driven Development (TDD)- Mentoring & Technical Leadership

Role & responsibilities Provide business support for production systems including analysis and troubleshooting of problems, interact with internal/external team members and business users throughout the application life cycleContributes and collaborates to assist designs, implements, maintains reliable and scalable applications/systems.Work with geographically diverse delivery groups (BAs, QAs and Developers) and DevOps teams in delivering quality solutionsResearch and develop on innovation technologies and strive for excellence and continuous improvement in software architecture, Agile methods and building systems.Adheres to agile methodology and operates and builds DevOps maturity. Ensuring delivery of business incremental change safely and reliably.Actively contributes to building DevOps maturity, incrementally and measurably improving delivery velocityQualifications:Overall 7+ years of software engineering experience in solution design & implementation5+ years of software engineering experience in solution design & implementation using Scala software development languageProven expertise and hands-on experience with Apache Spark/ Databricks and Azure Data FactoryExpert with data analysis in SQL Server/PostgreSQL with strong database query skills.Preferred candidate profile Overall 7+ years of software engineering experience in solution design & implementation5+ years of software engineering experience in solution design & implementation using Scala software development languageProven expertise and hands-on experience with Apache Spark/ Databricks and Azure Data FactoryExpert with data analysis in SQL Server/PostgreSQL with strong database query skills.Provide business support for production systems including analysis and troubleshooting of problems, interact with internal/external team members and business users throughout the application life cycleContributes and collaborates to assist designs, implements, maintains reliable and scalable applications/systems.Work with geographically diverse delivery groups (BAs, QAs and Developers) and DevOps teams in delivering quality solutionsResearch and develop on innovation technologies and strive for excellence and continuous improvement in software architecture, Agile methods and building systems.Adheres to agile methodology and operates and builds DevOps maturity. Ensuring delivery of business incremental change safely and reliably.Actively contributes to building DevOps maturity, incrementally and measurably improving delivery velocity.

Role: Bigdata Developer - Scala SparkExp: 5+ YrsMode of Work: WFO All 5 daysLocation: Chennai/Bangalore/PuneInterview: Any one Level F2FJob Description: Total IT / development experience of 3+ years Experience in Spark (Scala-Spark ) developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB Deep knowledge of Scala-Spark libraries to develop and debug complex data engineering challenges Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies Exposure to deploying on Cloud platforms At least 2 years of development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark-Scala At least 2 years of development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS At least 2 years of developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, Unix Shell Scripting, TDD, CI/CD, Change Management to support DevOps

About the role: You will spend time ensuring the products have the best technical design and architecture; you would be supported by peers and team members in creating best-in-class technical solutions. Identify technical challenges proactively and provide effective solutions to overcome them, ensuring the successful implementation of features and functionality. Quickly respond to business needs and client facing teams demand for features, enhancements and bug fixes. Work with AI tech and AI leaders in shaping and scaling the software products and hosting manufacturing focussed AI and ML software products Required Skills & Experience: You should have 5-8 years of experience, with deep expertise in backend technologies. Must have: Expert in coding for business logic, server scripts and application programming interfaces (APIs) Must have: Should have expertise in multiple programming languages (JAVA SPRING, springboot, Python, SCALA, NodeJS, Golang, etc.); HTML,CSS, Javascript (required to build APIs). Excellent in writing optimal SQL queries for backend databases; CRUD operations for databases from applications. Exposure to relational databases - MYSQL, Postgres DB, non-relational: MongoDB, Graph based databases, HBASE, Cloud native big data stores; willing to learn and ramp up on multiple database technologies . Must have at least 1 public cloud platform experience (GCP/Azure/AWS; GCP preferred). Good to have: Basic knowledge of Advanced Analytics / Machine learning / Artificial intelligence (has to collaborate with ML engineers to build backend of AI-enabled apps) Product development experience.

Profile:- Scala DeveloperRequired Experience:- 2+ YearsRequired Experience:-Strong scala programming skills and experience with Scala frameworks such as Akka.Efficient in designing and developing REST APIs.Experience with SQL and NoSQL databases.Proficiency in software design patterns and principles.Experience with version control tools such as Git.Good understanding of Agile methodologies and a collaborative mindset.Excellent problem-solving and analytical skills.Experience in unit testing (eg. JUnit/ Mockito).Experience in cloud-based environments such as AWS or Azure.Experience with Kafka and Elasticsearch.

About Crion LearningAt Crion Learning we're bringing an innovative and new approach to improve Education, Skill development and Training undertakings through the combination of Immersive digital simulations, Roleplay concepts and Social & Emotional aspects. We work on use-cases targeting students, working professionals and corporatesRoles & Responsibilities:Design, develop, and maintain scalable data pipelines and ETL processes to ingest, transform, and load data from various sources into our data warehouse.Build and optimize data models and schemas to support data analytics and reporting requirements.Implement and maintain data governance practices to ensure data quality, consistency, and security.Identify and resolve performance issues in data processing and recommend improvements to optimize data pipelines.Collaborate with infrastructure and operations teams to ensure the availability, reliability, and scalability of data systems.Stay up-to-date with emerging technologies and industry trends in data engineering, and evaluate and recommend tools and frameworks to enhance data processing capabilities.Create and maintain documentation for data engineering processes, including data flows, data lineage, and system architecture.Relevant skills required Proven experience as a Data Engineer or in a similar role, with a strong understanding of data integration, ETL processes, and data modeling.Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).Strong programming skills in at least one language, such as Python, Java, or Scala.Experience with big data processing frameworks like Hadoop, Spark, or similar technologies.Knowledge of cloud platforms, such as AWS, Azure, or Google Cloud, and experience with their data services (e.g., S3, Redshift, BigQuery).Familiarity with data visualization and business intelligence tools (e.g., Tableau, Power

5+ years of hands-on experience in data/information architecture and data warehouse design within hybrid environments (e.g., RDBMS/NoSQL; on-prem/cloud) and databases (especially Snowflake, Vertica, Teradata).Prior experience in the design, development, and migration of on-prem databases and applications to a public cloud platform, utilizing IaaS, PaaS, Databricks, Linux VMs, etcHands-on knowledge of Azure, Python, Scala, Spark, SQL, and Databricks.Ability to write complex and efficient SQL queries utilizing parametrization and optimization.

Job Description: 3+ years of Spark experience 3+ years of scala or Py-spark hands-on experience (Must Have) 3+ years of AWS familiar with S3, EMR, Redshift.

OUR REQUIREMENTS Professional experience as a Scala developer Knowledge of Akka, event driven systems and functional programming Experience with working with large code-bases Good spoken and written English communication skills, ability to express ideas clearly Experience or strong interest in the financial industry Experience building scalable, distributed applications in Scala and Java Strong understanding of Algorithms and Data Structures Experience in developing software in an agile environment Interest in the latest programming trends such as functional and reactive programming Knowledge of relational and non-relational database systems Experience in implementation of APIs for integration with internal and external systems Strong problem-solving skills & ability to learn in a fast paced environment.

DATA ENGINEER (Informatica BDM)Job Location: Dubai & Offshore (Chennai, Hyderabad, Bangalore)Experience: 5+ YearsNotice: 30 days or lessMax CTC: 15K AED per month/ 18LPA for offshoreJOB Description:Should have Strong expertise of Extraction, Transformation and Loading (ETL) mechanism using Informatica Big Data Management 10.2.X and various Push down mode using Spark, Blaze and Hive execution engine. Should have Strong expertise of Dynamic mapping Use case, Development, Deployment mechanism using Informatica Big Data Management 10.2.X. Should have experience on transforming and loading various Complex data source types such as Unstructured data sources ,No SQL Data Sources. Should have Strong expertise of Hive Database including Hive DDL, Partition and Hive Query Language. Should have Good Understanding of Hadoop Eco system (HDFS, Spark, Hive). Should have Strong expertise of SQL/PLSQL. Should have Good knowledge on working with Oracle/Sybase/SQL Databases. Should have Good knowledge of Data Lake and Dimensional data Modelling implementation. Should be able to understand the requirements and write Functional Specification Document, Design Document and Mapping Specifications.

Senior Data EngineerFull Time, Chennai, RemoteAbout OptiSolOptiSol a full services digital solution partner for Start-ups and Enterprises worldwide. We work on cutting edge digital solutions AI/ML, Modern Web and Mobile, Enterprise Cloud, Devops and Microservices. We are 100% Agile embracing modern application development strategies. People and Culture are our greatest differentiators. We are growing stronger with a 300+ team focused on new-age software development for the digital world. We invite people with a Growth Mindset to join us in our endeavor to create a better world through digital solutions for our customers. Position Summary:OptiSol DataOps Team engineers award winning cloud native applications to our worldwide customers. We provide simple digital solutions to complex business problems of our enterprise and startup customers. We look for agile developers with team spirit to continuously deliver value to our customers. We are a tribe of happy people excited in problem solving. Our team is geographically distributed, we speak many languages and we come from a variety of culture backgrounds. We are rapidly expanding, and we are looking for passionately curious people obsessed with customer happiness. Experience required:5 to 10 years Skills Required:As a Data Engineer you will be implementing foundational, robust and production ready data platforms to enable business data-discovery, self-service, AI/ML functions across a range of client types and industries, allowing them to do more with their data.Key responsibilities include;Deploying data repositories such as lakes and warehouses.Contribute to our growing portfolio of data solutions.Ongoing optimisation and management of data platforms.Development of transformational logic for data pipelines.Data evangelism. We want to show our clients how to followthe best practices for data.A passion for data!Focused data experience working with SQL and/or NoSQL solutions.Solid exposur

We have vacant of 3 Software engineer Jobs in Hyderabad,Chennai Experience Required : 3 Years Educational Qualification : Diploma, Other Bachelor Degree Skill Java Developer,microservices,SCALA,springboot etc.

Position:- Junior & Senior Data Engineer.Role - Data EngineerExp:- Jr.:- 4+ Years & Sr.: 7+ YearsSalary:- Jr. :- upto 20LPA & Sr.:- Upto 25 LPALocation:- WFHJob Description 7+ years of experience in IT programming, application/product development. At least 5 years' experience working in any of the Bigdata cloud ecosystems likeAWS/GCP Strong in SQL/RDBMS and any of the programming languages like Java/Python/Scala. Experience with one or more of the big data tools like Hadoop, Kafka, Spark, Beam etc. Good experience with AWS services like EC2, EMR, RedNote:- notice period max 30 Days ca apply

Position - Technical LeadExperience level - 7+ years Job location - Chennai / BangaloreRole DescriptionTheDataTeam is looking for a Technical Lead - Big Data who will be responsible for the following:To lead the technical discussion during the requirements gathering phaseCoordinate with Solution Architect to arrive at a technical solution for the problem statement.Lead the team for task estimation, planning, tracking and resolving technical blocker issues.Proactively keep the Project Managers and Client stakeholders updatedShould prepare Low Level Design DocumentShould participate in preparing High Level Design DocumentManage CI/CD PipelinesPeriodic Code Review and Code mergeManage cloud deploymentsTrack and help the client/vendor to complete the UAT Key skills:Should have minimum 7+ years of IT experience; at least 2-3 years of exp on BigData Ecosystem Should have good knowledge on Spark, NoSQL ,Oozie/Airflow,Scala/JavaCore Java or Python Skills is mustExperience on AWSExperience on developing complex data processing pipelinesHands on experience on either one of the Hadoop Distributions MapR, Cloudera and or Cloud (AWS EMR, Azure HD Insights, Qubole, etc)Got to have practical knowledge of Data Driven Approaches, Data SecurityApproachesWorked as Technical Lead for a minimum of 3 or more projects.Experience on performance tuning of Spark Jobs Assist in documenting requirements and resolving technical clarification with clientExperience on CI/CD DeploymentsGood knowledge on Linux and Bash commandsExperience on documenting LLD Documents

Experience with Databases like MySQL, Postgress, Mongo Strong Concepts of OOPS Should be able to build libraries and do structured coding. Immediate Joiner will be highly preferable.Qualifications-Diploma, B.Com, M.Com, BCA, BE/B.Tech, BSc, MCA, ME/M.Tech, MSc, PG Diploma, 12th Pass (HSE) Dear Candidate: We are looking for a Python Programmer with expert in building high-performing, scalable, enterprise-grade applications. You will be part of a talented software team that works on Research application Projects. Looking for skilled person in programming to join in our IT Team. Please let me know if you are interested and looking for the job opportunity at this time.Experience/fresher in core python scripting Experience with developing REST APIs on Flask, Cherry py, Django Experience with Django framework is good. Experience with packages like os, csv, pandas, Experience with Multi-threading and thread management.kindly share your cv to mail or what'app