Databricks Developer Jobs

We are looking for an experienced Data Engineer to join our team in Thiruvananthapuram. This role requires you to design, build, and maintain data systems that enable data-driven decision-making across the organization.- **Data Pipeline Development**: You will create and manage data pipelines that ensure smooth flow and transformation of data from various sources into databases or data warehouses.- **Data Integration**: You will work on integrating diverse data sources, ensuring consistency and accuracy in the data collected from different platforms.- **Database Management**: Your responsibility will include setting up and maintaining database systems, optimizing their performance, and ensuring data security.- **Collaboration with Stakeholders**: You will work closely with data scientists, analysts, and other stakeholders to understand their data needs and provide effective solutions.- **Performance Optimization**: You will monitor and enhance the performance of data processes, identifying and resolving bottlenecks to ensure efficient data handling.To be successful in this role, you should have a strong understanding of data modeling and ETL (Extract, Transform, Load) processes. Proficiency in programming languages such as Python or Java and experience with SQL databases is essential. Familiarity with big data technologies like Hadoop or Spark will be a plus. You should also possess excellent problem-solving skills and the ability to work collaboratively in a fast-paced environment. A minimum of 5 years of experience in data engineering or a related field is required.

Job Openings for 10 GenAI Developer Python / Agentic AI Jobs with minimum 4 Years Experience in Pune, having Educational qualification of : B.E with Good knowledge in Python., LangChain, Hugging Face, OpenAI SDK, FAISS, Pinecone, Weaviate, AWS, Databricks, PySpark, Git, CI/CD pipelines etc.Contact Detail -: Priyamd103@gmail.com 8105734745

Should have minimum 2 years of experience on Informatica IICS. Should have experience on Oracle and Azure Synapse and data bricks Should have Good knowledge on implementing SCD Type-1, Type-2. Should Involve in preparing Test cases for Data Validation

Role & responsibilities Provide business support for production systems including analysis and troubleshooting of problems, interact with internal/external team members and business users throughout the application life cycleContributes and collaborates to assist designs, implements, maintains reliable and scalable applications/systems.Work with geographically diverse delivery groups (BAs, QAs and Developers) and DevOps teams in delivering quality solutionsResearch and develop on innovation technologies and strive for excellence and continuous improvement in software architecture, Agile methods and building systems.Adheres to agile methodology and operates and builds DevOps maturity. Ensuring delivery of business incremental change safely and reliably.Actively contributes to building DevOps maturity, incrementally and measurably improving delivery velocityQualifications:Overall 7+ years of software engineering experience in solution design & implementation5+ years of software engineering experience in solution design & implementation using Scala software development languageProven expertise and hands-on experience with Apache Spark/ Databricks and Azure Data FactoryExpert with data analysis in SQL Server/PostgreSQL with strong database query skills.Preferred candidate profile Overall 7+ years of software engineering experience in solution design & implementation5+ years of software engineering experience in solution design & implementation using Scala software development languageProven expertise and hands-on experience with Apache Spark/ Databricks and Azure Data FactoryExpert with data analysis in SQL Server/PostgreSQL with strong database query skills.Provide business support for production systems including analysis and troubleshooting of problems, interact with internal/external team members and business users throughout the application life cycleContributes and collaborates to assist designs, implements, maintains reliable and scalable applications/systems.Work with geographically diverse delivery groups (BAs, QAs and Developers) and DevOps teams in delivering quality solutionsResearch and develop on innovation technologies and strive for excellence and continuous improvement in software architecture, Agile methods and building systems.Adheres to agile methodology and operates and builds DevOps maturity. Ensuring delivery of business incremental change safely and reliably.Actively contributes to building DevOps maturity, incrementally and measurably improving delivery velocity.

Job Title: Azure Data EngineerLocation: Bangalore Employment Type: Full-time Experience: 5-7 yearsKey ResponsibilitiesLead and execute complex data engineering projects from conception to deployment.Develop and maintain scalable data pipelines and architectures.Perform data extraction, transformation, and loading (ETL) to support data science initiatives.Design and implement data storage solutions for various healthcare finance applications.Collaborate with data scientists to optimize machine learning models and algorithms.Implement data governance and security best practices.Develop and maintain documentation for data engineering processes and workflows.Collaborate with cross-functional teams to integrate data engineering solutions into business processes.Mentor junior data engineers and contribute to the teams knowledge base.QualificationsMasters degree in Computer Science, Statistics, or a related field.Proven hands-on experience in data engineering and data analytics components.At least one significant contribution to an impactful real-world project.Demonstrated ability to learn, adapt to, and innovate new technologies and methodologies.Strong programming skills in Python and SQL.Experience with Azure Data Services, including Data Factory, Azure SQL, and Data Lake Storage.Hands-on experience with Databricks for big data processing and analytics.Proficiency in Power BI and Tableau for data visualization and reporting.Strong problem-solving and analytical skills.Excellent communication and collaboration abilities.Preferred QualificationsExperience in the healthcare finance industry.Experience with big data technologies such as Hadoop, Spark, etc.What We OfferCompetitive salary and benefits package.Opportunities for professional growth and development.A collaborative and innovative work environment.Mentoring by senior technical and business leaders.An unprecedented opportunity to make a meaningful impact on healthcare finance o

DatabricksDatabricks developer responsible for designing and implementing very large scale data engineering solutions in Databricks. You will be responsible to review business requests and translate them into technical solution and technical specification.

Looking for a skilled and experienced Data Engineers! As part of the team, you will be involved in the implementation of the ongoing and new initiatives for the company. If you love learning, think strategically, and innovate, and helping others, this job is for you!Role Responsibility:* Translate functional specifications and change requests into technical specifications* Translate business requirement document, functional specification, and technical specification to related coding* Develop efficient code with unit testing and code documentation* Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving* Setting up the development environment and configuration of the development tools* Communicate with all the project stakeholders on the project status* Manage, monitor, and ensure the security and privacy of data to satisfy business needs* Contribute to the automation of modules, wherever required* To be proficient in written, verbal and presentation communication (English)* Co-ordinating with the UAT team

Desired Role:Solid knowledge of Datawarehouse and Big Data Frameworks, preferably Databricks.Experience in Large scale Cloud DWH Migration, define and administer standard architecture methodologies, processes and tools across the engagement and best practices.Experience working in cloud-based AWS tech stack that includes Databricks, Spark, Airflow, Python, and Scala. Designing big data infrastructure to run large scale and complex data pipelines that collect, organize, and standardize data.Lead a team of Data engineers and design engineers.Mandatory skills*AWS, Databricks, Python, Spark, ScalaDesired skills*ExasolDomain*Retailnew onsite position on 6 month contract. It's for 10-13 yrs experience in Bigdata tech / data bricks.Open to Bangalore/ Pune/ Chennai/ Hyderabad/ Gurgaon once back from Germany

We are looking for an AI Engineer with 5 to 11 years of experience to join our team in Thiruvananthapuram. In this full-time role, you will work on developing innovative AI solutions and applications.**Key Responsibilities:**- **Develop AI Models:** Create and train advanced machine learning models to solve complex problems, ensuring they are accurate and efficient.- **Conduct Research:** Stay updated on the latest AI trends and research findings to implement cutting-edge techniques into projects.- **Collaborate with Teams:** Work closely with data scientists and software engineers to integrate AI features into existing applications and systems.- **Optimize Algorithms:** Fine-tune algorithms for performance improvements, ensuring they meet project requirements and consumer needs.- **Debug and Test:** Perform thorough testing and debugging of AI systems to identify issues and enhance functionality.- **Document Solutions:** Maintain clear documentation of algorithms and processes to facilitate knowledge sharing and onboarding of new team members.**Required Skills and Expectations:**The ideal candidate should have a strong foundation in machine learning, deep learning, and data analytics. Proficiency in programming languages such as Python or Java is essential, along with experience in frameworks like TensorFlow or PyTorch. You should possess excellent problem-solving skills and the ability to work collaboratively in a team. Strong communication skills are necessary to explain complex concepts to non-technical stakeholders and to contribute effectively to discussions. A degree in Computer Science, Engineering, or a related field is preferred.