Data Warehousing Job Vacancies in Bangalore

Role: Data Engineer 2.0Location - RemoteExperience: Min. 5 YearsNotice Period- Immediate to 15 Days or serving notice periodKey Responsibilities:Design and implement manual test strategies for real-time streaming use cases using Azure Service Bus, Event Hubs, Kafka, and Azure Functions.Validate Spark Streaming applications, including unbounded data flows, streaming DataFrames, checkpoints, and streaming joins.Develop test plans for containerized microservices deployed on Kubernetes, ensuring scalability and fault tolerance.Test data ingestion and transformation workflows across open table formats like Delta Lake, Apache Iceberg, and Hudi.Good to Have:Monitoring and troubleshooting system performance using observability stacks such as Prometheus, Grafana, and ELK.functional and performance testing on analytical databases and query engines such as Trino, StarRocks, and ClickHouse.Testing and validation of data products designed under data mesh architecture, ensuring domain-oriented data quality and governance.

Design, build, and maintain ETL/ELT data pipelines and data lake solutions to support analytics and AI/ML use cases. Ensure data quality, performance, and reliability across enterprise data platforms.Key ResponsibilitiesPipeline DevelopmentData Lake EngineeringPerformance & OptimizationCollaboration & SupportRequired Skills & Experience 4+ years of experience in data engineering or ETL development. Proficiency in SQL and Python (or Scala/Java) for data transformations. Hands-on with ETL tools (Informatica, Talend, dbt, SSIS, Glue, or similar). Exposure to big data technologies (Hadoop, Spark, Hive, Delta Lake). Familiarity with cloud data platforms (AWS Glue/Redshift, Azure Data Factory/Synapse, GCP Dataflow/BigQuery). Understanding of workflow orchestration (Airflow, Oozie, Prefect, or Temporal).Preferred Knowledge Experience with real-time data pipelines using Kafka, Kinesis, or Pub/Sub. Basic understanding of data warehousing and dimensional modeling. Exposure to containerization and CI/CD pipelines for data engineering. Knowledge of data security practices (masking, encryption, RBAC).Education & Certifications Bachelors degree in Computer Science, IT, or related field.Preferred certifications:o AWS Data Analytics Specialty / Azure Data Engineer Associate / GCP Data Engineer.o dbt or Informatica/Talend certifications.

About KenverseKenverse is a leading technology company building transformative SaaS solutions for the enterprise and education sectors. We are seeking a versatile expert to drive data insights and seamless system connectivity.The RoleWe are hiring a Senior Analyst/Consultant to join our team in one of three locations. This role is a specialized blend of analytics and integration, critical to our data strategy.Detail SpecificationExperience: 3 to 7 YearsCompensation: Up to 35 Lakhs per annumLocation: Kolkata, Bangalore, CoimbatoreWork Mode: Work from Office (WFO)Education: BCA, BBA, BSc, B.Tech/BE (Any Field)Key Skills RequiredYou must have hands-on, proven expertise in all three areas:1. Tableau Development: Designing and optimizing high-impact data visualization dashboards and reports.2. CRM Analytics Expert: Analyzing customer data, performing segmentation, and driving insights for sales/marketing strategies.3. MuleSoft: Developing and deploying API-led integration solutions using the Anypoint Platform to ensure robust system connectivity.How to ApplyInterested candidates, please send your resume immediately.WhatsApp: 8013914799LinkedIn: Send your resume via my inbox.

Job Description:Yrs of Exp : 10 + yrsMode : 3 days a weekLocation: BangaloreWork Type : PermanentKey ResponsibilitiesDesign and Development:Architect, implement, and optimize scalable data solutions.Develop and maintain data pipelines, ETL/ELT processes, and workflows to ensure the seamless integration and transformation of data.Collaboration:Work closely with data scientists, analysts, and business stakeholders to understand requirements and deliver actionable insights.Partner with cloud architects and DevOps teams to ensure robust, secure, and cost-effective data platform deployments.Data Management:Manage and maintain data lakes, data warehouses, and real-time analytics systems.Ensure high data quality, integrity, and security across the organization.Performance Optimization:Monitor and enhance system performance, troubleshoot issues, and implement optimizations as needed.Leverage Microsoft Fabrics advanced analytics and AI capabilities for innovative data solutions.Best Practices & Leadership:Lead and mentor junior engineers to foster a culture of technical excellence.Stay updated with industry trends and best practices, especially in the Microsoft ecosystem.Required:Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.10+ years of experience in data engineering, with a proven track record of working on large-scale data platforms.Expertise in Microsoft Fabric and its components (e.g., Synapse, Data Factory, Azure Data Lake, Power BI).Strong proficiency in SQL, Python, and Spark.Experience with cloud platforms, particularly Microsoft Azure.Solid understanding of data modeling, data warehousing, and ETL/ELT best practices.Excellent problem-solving, communication, team management and project management skills.Preferred:Familiarity with other cloud platforms (e.g., AWS, GCP).Experience with machine learning pipelines or integrating AI into data workflows.Certifications in Microsoft Azure or related technologies.

Job DescriptionAs a Data & Analytics Architect, you will lead key data initiatives, including cloud transformation, data governance, and AI projects. You'll define cloud architectures, guide data science teams in model development, and ensure alignment with data architecture principles across complex solutions. Additionally, you will create and govern architectural blueprints, ensuring standards are met and promoting best practices for data integration and consumption.Strong cloud data architecture knowledge (preference for Microsoft Azure)8-10+ years of experience in data architecture, with proven experience in cloud data transformation, MDM, data governance, and data science capabilities.Design reusable data architecture and best practices to support batch/streaming ingestion, efficient batch, real-time, and near real-time integration/ETL, integrating quality rules, and structuring data for analytic consumption by end uses.Ability to lead software evaluations including RFP development, capabilities assessment, formal scoring models, and delivery of executive presentations supporting a final recommendation.Well versed in the Data domains (Data Warehousing, Data Governance, MDM, Data Quality, Data Standards, Data Catalog, Analytics, BI, Operational Data Store, Metadata, Unstructured Data, non-traditional data and multi-media, ETL, ESB).Experience with cloud data technologies such as Azure data factory, Azure Data Fabric, Azure storage, Azure data lake storage, Azure data bricks, Azure AD, Azure ML etc.Experience with big data technologies such as Cloudera, Spark, Sqoop, Hive, HDFS, Flume, Storm, and Kafka.

data entry job in flipkart warehouse

Work mode : Hybrid Overall 4-9 yrs of IT experience preferably in cloudMin 3 years in Azure Databricks on development projectsShould be 100% hands on in Pyspark codingShould have strong SQL expertise in writing advanced/complex SQL queriesDWH experience is a must for this roleExperience in programming using Python is an advantageExperience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirementsShould be able to understand system architecture which involves Data Lakes, Data Warehouses and Data MartsExperience to own end-to-end development, including coding, testing, debugging and deploymentExcellent communication is required for this role

Knowledge of cloud data warehousing in Azure, AWS.Knowledge of RDBMS and data modellingWorking with different storage and files types.Proficiency in SQL for writing complex queriesManaging relational databases, and performing data operationsExperience with ETL (extract, transform, load) tools and data modelling

Job Description AWS Data Engineer with min of 5 to 7 years of experience. Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines. Connect with stakeholders daily to discuss project progress and updates. Work within an Agile process to deliver projects in a timely and efficient manner. Design and develop Airflow DAGs to schedule and manage ETL workflows. Transform SQL queries into Spark SQL code for ETL pipelines. Develop custom Python functions to handle data quality and validation. Write PySpark scripts to process data and perform transformations. Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes. Run Spark jobs on AWS EMR cluster using Airflow DAGs. Monitor and troubleshoot ETL pipelines to ensure smooth operation. Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture. Collaborate with other members of the data engineering team to improve processes and implement new technologies. Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.

Mandatory Skills:Apache Spark and either PySpark or Scala: Extensive hands-on experience with Spark for large-scale data processing and analysis. Proficiency in either PySpark or Scala for developing Spark applications.Databricks: Strong expertise in using Databricks for big data analytics, data engineering, and collaborative work on Apache Spark.Github: Proficient in version control using Git and GitHub for managing and tracking changes in the codebase.Data Warehousing (DWH): Experience with one or more of the following DWH technologies Snowflake, Presto, Hive, or Hadoop. Ability to design, implement, and optimize data warehouses.Python: Advanced programming skills in Python for data manipulation, analysis, and scripting tasks.SQL: Strong proficiency in SQL for querying, analyzing, and manipulating large datasets in relational databases.Data Streaming or Data Batch: In-depth knowledge and hands-on experience in both data streaming and batch processing methodologies.Good to Have:Kafka: Familiarity with Apache Kafka for building real-time data pipelines and streaming applications.Jenkins: Experience with Jenkins for continuous integration and continuous delivery (CI/CD) in the data engineering workflow.Responsibilities:Design, develop, and maintain scalable and efficient data engineering solutions using Apache Spark and related technologies.Collaborate with cross-functional teams to understand data requirements, design data models, and implement data processing pipelines.Utilize Databricks for collaborative development, debugging, and optimization of Spark applications.Work with various data warehousing technologies such as Snowflake, Presto, Hive, or Hadoop to build robust and high-performance data storage solutions.Develop and optimize SQL queries for efficient data retrieval and transformation.Implement both batch and streaming data processing solutions to meet business requirements.Collaborate with other teams to integrate data engineering

We have vacant of 5 Data Engineer Jobs in Bangalore, Noida, Experience Required : 9 Years Educational Qualification : Other Bachelor Degree Skill Data Warehousing, ETL, Python, AWS, SCALA, data engineer

10+ years' of experience in a technical role with expertise in data governance and data warehousing - such as setting up DataBricks as a Service modelProduction deployment experience with data governance solutions and hands-on experience with cloud data lakes.Experience with design and implementation of data warehousing technologies.Deep Specialty Expertise with scaling big data workloads that are performant and cost-effective - including technologies such as Delta LakeSupport customers by authoring reference architectures, how-to, and demo applicationsExperience working with Enterprise AccountsIntegrate Databricks with 3rd-party applications to support customer architectures.Experience designing and implementing architectures within public clouds (AWS, Azure or GCP)Good communication Skillsif you are interested kinly drop a mail we reach us

Job DescriptionThe Lead Data Engineer is responsible for finding trends in Data sets and Developing Algorithms to help make raw data more useful to the Organization. This role requires a significant Set of Technical Skills, including a deep Knowledge of SQL Database Design and Multiple Programming languages along with team management skillsiSOCRATES is looking to add a Lead Data Engineer to its growing Analytics team. The Lead Data Engineer will lead the team that is responsible for finding trends in Data sets and Developing Algorithms to help make raw data more useful to the Organization. The Lead Data Engineer will report directly to the Senior Director Qualifications Overall, 8-12 years of experience in data & analytics Have strong experience in SQL/NoSQL databases Design and build production data pipelines from ingestion to consumption within a big data architecture, using Python/Scala/Java Design, build and operationalize large-scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with Mandatory - Redshift, S3, Athena, Good to have - Glue, Snowflake Design and implement data engineering, ingestion, and curation functions on AWS cloud using AWS native or custom programming Perform detailed assessments of current state data platforms and create an appropriate transition path to AWS cloud Should be able to understand the data very well, create a pattern on structured /non-structured data Strong knowledge of Data warehouse, Data Modelling (Preferably Dimensional Modelling Kimball) Proficiency in both ETL & ELT AWS Certified Data Analytics Specialist / AWS Certified ML Specialist will be an added advantage Exposure to Media & Marketing is a plus Having knowledge of GCP is a plus Having knowledge of 1 or more visualization tools is a plus

We are looking for Informatica trainer for online and offline training, daily one to two hours classes, if u r interested please let me know.

Inventory Manager JDLocation: BangaloreExperience: 2 yearsWe are looking for an Inventory Manager with 2 years of experience to perform daily tasks that will support our team.Our warehouse currently requires an Inventory Manager to handle product management and distribution and develop a comprehensive inventory tracking system to streamline our business. The main responsibilities of this position include meeting inventory goals, managing tracking systems and acting as a liaison to other departments. The successful candidate will offer recommendations to ensure ideal levels of inventory in the warehouse and in stores. Prospective candidates with extensive inventory control experience in a warehouse setting are encouraged to apply.Responsibilities:Ensure accurate product inventory for clientsDevelop an inventory tracking system to streamline our business operationsCommunicate with our Warehouse Manager about current stock and potential issues with ordersConduct daily analyses to forecast potential inventory issuesReport on inventory activities and variancesAssess new inventory to ensure it is ready for shipping or deliveryDevelop and implement inventory control procedures and best practicesSkills:Bachelors Degree in Business, Finance or related field2+ years experience in inventory, distribution and operational procedures Supervisory experienceAble to multi-task and work independentlyProven leadership skillsExcellent written and verbal communication skillsIn-depth understanding of distribution workplacesInventory training an asset

We are searching for an accountable, multitalented data engineer to facilitate the operations of our data scientists. The data engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field. During various aspects of this process, you should collaborate with coworkers to ensure that your approach meets the needs of each project.Job DescriptionBasic concepts of Data Engineering, Hadoop, Data Warehousing, Designing & Implementing large-scale Distributed Data platforms.Building distributed platforms or services.SQL, NoSQL, Query Tuning & Performance Optimization.General advanced Scala or Java or python experience (Design, Code review, build, unit testing, integration & regression testing).Knowledge of Data Analysts and provide the data they need and guide them on the issues.Knowledge of high-level JavaScript concepts like asynchronous programming, closures, promises, data-binding, async-await, etc.DevOps experience in Jenkins, Maven, GitHub, Artifactory/Jfrog, CI/CD, TDD & BDD.Big Data Processing: Hadoop, Sqoop, Spark.Data Streaming: Experience with Kafka and Spark Streaming.Data Validation & Data Quality.Aggregate and clean raw data from different sources.Explore ways to enhance data quality and reliability.Collaborate with data scientists and architects on projects.

Position: Data Engineer with Python.Location: RemoteDuration: 6 to 12 months+Work hours: 2/3 pm to 10/11 pm ISTType - ContractMinimum 5+ years in Data Engineer role.Expert in PythonFamiliarity with Spark, PySpark.Knowledge in at least any one of the Cloud platform - Azure or GCP or AWSExperience in writing complex and efficient ETL jobs and Data pipelines.Excellent in writing complex SQL Queries and ScriptsProven expertise in modern Data Architecture, Data Modeling, Database architecture, Database Design, Database programming (SQL, Python, etc..)Experience with analytics platforms in Cloud (Azure, GCP, AWS etc..)Experience designing and developing ETL and ELT processes in a variety of platforms (e.g. Azure Data Factory, Data Bricks, etc....)Experience with Data Collaboration Platforms (e.g. Calibra, Alation) and Automated meta data management solutionsExpertise in architecting Master Data Management, Operational Data Stores, Data Lakes, Data Warehousing solutions.

Having good & strong knowledge of Data Ware House, Tableau & Power BI

Position: Qlik Compose ExpertsSenior developer with 4+ years of experience in IT, which comprises of designing & implementation of Enterprise Data Warehouse systems, complex ETL processes, design and development, Data Modelling relevant experience in database analysis, design and development. Currently using QLIK Compose. Competent in ETL scripts and data modelling.Experience in designing and implementation of complex business logic using the ETL tools like Attunity Compose & Replicate, Extensive experience in performance tuning of SQL/PLSQL and ETL processes.End to End knowledge of project implementation by following SDLC and Agile methodology. Excellent analytical and communication skills, result-oriented, quick to learn and adapt to new technologies with a good track record of team leadership and mentoring. Extensive SQL more importantly Compose for Data warehouse.Please send your updated resume to the below mentioned mail-id.

Job Description :Senior MSBI Developer (SSIS) - BangaloreExperience required : 6 to 8 yearsLooking for immediate joiner (Work from home )SSIS with BFSI DomainLocation : Bangalore/ RemoteEducational : Any graduation- 6-8 years of work experience in designing and maintaining SSRS/SSIS environments Integrating, Migration, and conversions experience- Good experience in SSRS reports conversions of SSRS reports into crystal reports- Good experience in Architecture, team handling, and architecture flows.- Strong understanding and experience with Microsoft SQL Server database platform and SQL Server reporting and Analytics Services (SSRS, SSAS, and SSIS)- Hands-on experience with business intelligence, data architecting, data mining, large-scale data modeling, and business requirements gathering/analysis.- Good experience/ Knowledge of admin ,Data modeling in OLAP plus working technical knowledge of current systems software, protocols, and standards, including SQL, TSQL, ODBC, .NET, and Business Intelligence Standards- Expert experience in creating and using store procedures, views and user-defined functions- Well experience in Data Extraction, Transforming, and Loading (ETL) using various tools such as SQL Server Integration Services (SSIS), Data Transformation Services (DTS)- Develop Queries for generating drill down reports in SSRS latest version- Experience in working on SSRS Upgrade Projects (Upgrade from old version to new) Strong aptitude for modern BI solution development using Power BI and SQL Server- Deep Understanding of dimensional data modeling concepts as well as data warehouse design and lifecycle management principles- Collaborate with Performance Improvement, Quality Systems, and stakeholders to analyze and define data requirements needed to support the business processes; verify accurate data reporting; and integrate the data requirements throughout the data systemsNeed Immediate joiners or 15 days notice period.

Our company is searching for a meticulous and experienced data architect to join our talented team. Your central responsibility as the data architect will be to develop, optimize, and oversee our companys conceptual and logical data systems. Your duties may include preparing architect reports, monitoring the system, and supervising system migrations.Job DescriptionDesign and implement effective database solutions and models to store and retrieve company data.Examine and identify database structural necessities by evaluating client operations, applications, and programming.Assess database implementation procedures to ensure they comply with internal and external regulations.Install and organize information systems to guarantee company functionality.Prepare accurate database design and architecture reports for management and executive teams.Oversee the migration of data from legacy systems to new solutions.Monitor the system performance by performing regular tests, troubleshooting, and integrating new features.Recommend solutions to improve new and existing database systems.Educate staff members through training and individual support.Offer support by responding to system problems in a timely manner.Strong knowledge of database structure systems and data mining.Excellent organizational and analytical abilities.

Strong knowledge of MS SQL Server Database (T-SQL, Stored Procedures, Triggers, Functions, SSIS, etc), programming (XML or ETL frameworks), and Data Warehousing with database queries/analysis, and other scripting/programming languages (e.g., Python).Well conversant in providing technical solutions, database fine-tuning, performance improvement, providing estimation and should be able to justify the same with multiple stakeholders.Have knowledge in programming and coding including R, Python, and SQL with working in a risk vector (e.g., fraud, abuse, security).Ability to prioritize tasks, with attention to detail, and well organized to complete workload in a timely and effective manner.Ability to clearly communicate technical concepts with multiple cross-regional and cross-functional stakeholders.Excellent problem-solving, critical thinking, written and verbal communication, and analytical skills.Interest in aptitude in data, metrics, analysis, and trends.