Data Architect Job Vacancies in Bangalore

Job DescriptionAs a Data & Analytics Architect, you will lead key data initiatives, including cloud transformation, data governance, and AI projects. You'll define cloud architectures, guide data science teams in model development, and ensure alignment with data architecture principles across complex solutions. Additionally, you will create and govern architectural blueprints, ensuring standards are met and promoting best practices for data integration and consumption.Strong cloud data architecture knowledge (preference for Microsoft Azure)8-10+ years of experience in data architecture, with proven experience in cloud data transformation, MDM, data governance, and data science capabilities.Design reusable data architecture and best practices to support batch/streaming ingestion, efficient batch, real-time, and near real-time integration/ETL, integrating quality rules, and structuring data for analytic consumption by end uses.Ability to lead software evaluations including RFP development, capabilities assessment, formal scoring models, and delivery of executive presentations supporting a final recommendation.Well versed in the Data domains (Data Warehousing, Data Governance, MDM, Data Quality, Data Standards, Data Catalog, Analytics, BI, Operational Data Store, Metadata, Unstructured Data, non-traditional data and multi-media, ETL, ESB).Experience with cloud data technologies such as Azure data factory, Azure Data Fabric, Azure storage, Azure data lake storage, Azure data bricks, Azure AD, Azure ML etc.Experience with big data technologies such as Cloudera, Spark, Sqoop, Hive, HDFS, Flume, Storm, and Kafka.

Key Responsibilities Requirement Analysis: Collaborate with stakeholders to understand businessrequirements and data sources, and define the architecture and design of dataengineering models to meet these requirements. Architecture Design: Design scalable, reliable, and efficient data engineering models,including algorithms, data pipelines, and data processing systems, to support businessrequirements and quantitative analysis. Technology Selection: Evaluate using POCs and recommend appropriate technologies,frameworks, and tools for building and managing data engineering models, consideringfactors like performance, scalability, and cost-effectiveness. Data Processing: Develop and implement data processing logic, including data cleansing,transformation, and aggregation, using technologies such as AWS Glue, Batch, Lambda. Quantitative Analysis: Collaborate with data scientists and analysts to develop algorithmsand models for quantitative analysis, using techniques such as regression analysis,clustering, and predictive modeling. Model Evaluation: Evaluate the performance of data engineering models using metricsand validation techniques, and iterate on models to improve their accuracy andeffectiveness. Data Visualization: Create visualizations of data and model outputs to communicateinsights and findings to stakeholders.Data Engineering: Understanding of Data engineering principles and practices, includingdata ingestion, processing, transformation, and storage, using tools and technologiessuch as AWS Glue, Batch, Lambda. Quantitative Analysis: Proficiency in quantitative analysis techniques, including statisticalmodeling, machine learning, and data mining, with experience in implementingalgorithms for regression analysis, clustering, classification, and predictive modeling. Programming Languages: Proficiency in programming languages commonly used in dataengineering and quantitative analysis, such as Python, R, Java, or Scala,

Technical Skills: In-depth knowledge of AWS services (IAM, Redshift, Step Functions) Infrastructure as code tools (CloudFormation Stack) Database technologies (SQL, NoSQL) Data processing and analysis tools (AWS Glue, EMR) Big data frameworks (Hadoop, Spark) ETL tools (IBM DataStage, ODI, Informatica, Talend, Microsoft SQL Server Integration Services, Apache Nifi) Data warehousing architecture, Architecture Design Collaboration tools (JIRA, Confluence).If you are looking for a new challenge and have the relevant experience, apply now or tag someone who'd be perfect for this role.Send your resume to : hr@talme.in

Design, develop, and maintain scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.Work extensively with the Kafka and Hadoop ecosystem, including HDFS, Hive, and other related technologies.Write efficient SQL queries for data extraction, transformation, and analysis.Implement and manage Kafka streams for real-time data processing.Utilize scheduling tools to automate data workflows and processes.

Are you a Mid/Senior level T-Shaped AWS expert with specialization in DevOps and Data Engineering space? If yes, We have an exciting opportunity just for you.One of our reputed European Client is looking for AWS engineers to help them build secure, resilient and cost-effective solutions on AWS platform to reap the benefits from their investment in AWS platform and services.We are looking for self-motivated, highly experienced engineers, possessing great analytical and excellent communication skills for this client facing role.What do we expect from you?Role: Data Engineer (AWS)*Mandatory*Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, preferably on AWS.Experience in ingesting batch and streaming data from various data sources.Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)Experience in developing ETL, OLAP based and Analytical Applications.Ability to quickly learn and develop expertise in existing highly complex applications and architectures.Comfortable working in Agile projects*Desirable*Exposure to AWS platform's data services (AWS Lambda, Glue, Athena, Redshift, Kinesis etc.)Knowledge of DevOps and CD/CD tools.Experience in handling unstructured dataKnowledge of Financial Markets domainKeywords: Data Engineer, Data Pipelines, Data Ingestion, AWS Lambda, AWS Athena

Job Description AWS Data Engineer with min of 5 to 7 years of experience. Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines. Connect with stakeholders daily to discuss project progress and updates. Work within an Agile process to deliver projects in a timely and efficient manner. Design and develop Airflow DAGs to schedule and manage ETL workflows. Transform SQL queries into Spark SQL code for ETL pipelines. Develop custom Python functions to handle data quality and validation. Write PySpark scripts to process data and perform transformations. Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes. Run Spark jobs on AWS EMR cluster using Airflow DAGs. Monitor and troubleshoot ETL pipelines to ensure smooth operation. Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture. Collaborate with other members of the data engineering team to improve processes and implement new technologies. Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.

I require a person to assist us with a Python Developer Udemy Course. If the person has the training videos ready, it's the best. If not, the person should be willing to create a course. The person has to create the full course.To Apply please go to GerardYadGG LinkedIn's Page, you will find the website link there, you can apply there. Please apply there to be considered.100% worldwide remote.ID: PL300Thank You.

Role : Informatica MDM Developer / Profisee MDM DeveloperSkills : 5+ years direct experience in MDM design, development, support and operations with Informatica MDM tool suite. Hands-on expertise required with Informatica tools and utilities such as Data Controls, Data Director and Data Quality. Extensive knowledge and experience in defining Master Data Management strategies, implementing MDM services and capabilities, Metadata Management, Data Governance, and Data Quality solutions. Familiarity with enterprise data integration technologies and methods such as ETL, data replication, and data services. Experience with enterprise level data analysis and integration work and/or providing data focused systems integration solutions. Demonstrated business acumen and the ability to apply technology solutions to solve business problems.. Experience with Profisee Informatica is first preference if you dont et please send MDM Informatica experience profiles..Min 5+ relevant experience required.ACS Notes:Aparajita time to join: ie: Immediate or within 21 daysWork location : Bangalore, Chennai, Hyderabad Hybrid( 2 or 3 days work from Office).No of positions : 8Experience : 5+ YearsBudget : 5+ yrs upto 11 lpa6+ yrs upto 13 lpa7+ yrs upto 15 lpa

Software Galaxy Systems, LLC (SGS) is an award-winning Contingent Workforce Services firm providing a broad range of integrated suite of services through a global delivery platform. SGS brings innovative talent management strategies to empower its clients to stay focused on growth of their core competencies. SGS has developed a comprehensive process-oriented methodology to manage high-volume contingent labor, payroll services and SOWs for todays competitive landscape.SGS is proud of the partnerships it has built with its clients, MSPs, and employees which has allowed it to deliver unparalleled service to its wide-ranging customer base. SGS is a certified minority owned enterprise that provides innovative yet practical solutions, from concept through execution. We combine technology with strategy and aim to deliver results today that endure tomorrow. SGS client centric approach delivers unparalleled value with vastly responsive, streamlined and highly process oriented workforce solutions.SGS has been awarded and acknowledged by leading MSPs (i.e., KellyOCG, TAPFIN, Guidant Global, etc.) for its exemplary performance in the contingent workforce space.

Should be graduated from NIT or equivalent, MBA is an added advantage Previous employments should be technology oriented Experience not to go beyond than 17 yrs Should not have changed more than 3 employments Current role : Manager / Sr Manager Current status to be employed only Responsibilities : Should have led a team of 100 , min of 6 yrs in AWS Technical PM's to have cloud migration experience (AWS/ Azure/ GC) Should be able to travel and face client

Job Description:Significant experience in data and reporting requirements gathering and documentation, data analysis and design, developing data visualisation wireframes, and interfacing with business teams on user acceptance testing and training.Experience in gathering documenting business process and rules, source system process, and data flows as well as data mapping for all fields in Bl report to support the development and implementation teams.Experience in analysis of data fields required to migrate data, or to develop data feed between internal systems or third-party applications as well as ability to identify data sources for each of these requirements including the design of detailed mappings and logic/transformations.Experience in data requirements analysis for the data tables/ data marts supporting for the reporting requirements.Experience in preparing test cases, user manuals and user training on data and reporting artefacts.Experience in using data management tools (Data Governance, Metadata Management, Data Quality, Master/Reference Data, etc.), SQL, data analysis tools and Business Intelligence reporting toolsExcellent verbal and written communication skills, capable of communicating with audiences at all levels with clarity, impact and influence.Demonstrated evidence of being self-motivated, results orientated and driven to improve business processes.Demonstrated evidence of ability to partner effectively with business users and establish strong professional relationships across the enterprise.

10+ years' of experience in a technical role with expertise in data governance and data warehousing - such as setting up DataBricks as a Service modelProduction deployment experience with data governance solutions and hands-on experience with cloud data lakes.Experience with design and implementation of data warehousing technologies.Deep Specialty Expertise with scaling big data workloads that are performant and cost-effective - including technologies such as Delta LakeSupport customers by authoring reference architectures, how-to, and demo applicationsExperience working with Enterprise AccountsIntegrate Databricks with 3rd-party applications to support customer architectures.Experience designing and implementing architectures within public clouds (AWS, Azure or GCP)Good communication Skillsif you are interested kinly drop a mail we reach us

At Medvatic Pty Ltd, we rely on a talented group of engineers to address the numerous problems and conundrums presented by our continually changing technical stack. We're looking for a full-stack developer who's willing to work with cutting-edge architectures and technologies at a company that constantly pushes the envelope. This individual will be in charge of all aspects of projects. The ideal applicant has hands-on experience building products from top to bottom of the stack and a solid grasp of web frameworks, APIs, databases, and several back-end programming languages.Build highly scalable distributed systems that offer good user experiences and quantifiable company growth by working across the entire stack.Create new functions and infrastructure to support the needs of projects and businesses that are arising quickly.Take charge of new project development and implementation.Maintain high standards for code quality and application design, and make sure that the application performs, scales, and is available.Technical Skills:React, Node JS, APIGoogle Cloud PlatformFrontend web development using React Node JS ecosystem AWS

Our company is searching for a meticulous and experienced data architect to join our talented team. Your central responsibility as the data architect will be to develop, optimize, and oversee our companys conceptual and logical data systems. Your duties may include preparing architect reports, monitoring the system, and supervising system migrations.Job DescriptionDesign and implement effective database solutions and models to store and retrieve company data.Examine and identify database structural necessities by evaluating client operations, applications, and programming.Assess database implementation procedures to ensure they comply with internal and external regulations.Install and organize information systems to guarantee company functionality.Prepare accurate database design and architecture reports for management and executive teams.Oversee the migration of data from legacy systems to new solutions.Monitor the system performance by performing regular tests, troubleshooting, and integrating new features.Recommend solutions to improve new and existing database systems.Educate staff members through training and individual support.Offer support by responding to system problems in a timely manner.Strong knowledge of database structure systems and data mining.Excellent organizational and analytical abilities.

Job DescriptionThe Big Data/Analytics Solution Architect is responsible for understanding emerging and evolving end user usage models and requirements in Big Data and Analytics, documenting those usage models and business, technical and user requirements and designing a solutions architecture to meet those requirements and specifying an implementation HW and SW solution stack. Solution architects document the solution architectures and solution requirements and, when needed, define end user proofs of concept to test the architectures, usage models and corresponding Intel technologies in testbed or real end user environments. They also work with end users and ecosystem partners to deploy those solutions in early adopter production environments. A strong candidate will have:Experience in Requirements Engineering, Solution Architecture, Design, Development and DeploymentA broad set of technical skills and knowledge across hardware, software, systems and solutions development and a across more than one technical domain.Demonstrated experience in real world IT or other solutions environments including creating (on your own or with a team) a product or IT solution in the area of Big Data/AnalyticsStrong communication skills including representing your company in industry standards organizations or industry technical forums or events in Cloud SecurityStrong technical team leadership, mentorship and collaboration.Ability to develop technical relationships with end-users, ISVs, OEMs and Intel platform architects and Proof-Of-Concept engineers.

Urgent requirement for Data Architect.Exp:- 6+ YearsSalary: Upto 18 LPALocation:- Banglore. (Currently WFH)Working Hours : flexible.Job DescriptionWhat are we looking for?? Minimum of 6+ years of experience as a Data Engineer in the Azure Cloud platform.? Bachelors Degree in Computer Science is required and Masters Degree in Computer Science preferred.? Design and develop new solutions on the Azure Platform.? Strong working knowledge of coding languages, particularly Python, SQL, PySpark and shell script? Hands-on experience with Azure services such as Azure Data Factory, Azure Databricks, Azure Functions, Synapse, ADLS Gen2, and Azure SQL server? Excellent understanding of data technologies, including traditional (RDBMS) platforms, non-traditional (NoSQL) platforms, and BigData platforms.? Prior experience in big data implementations (Batch/Stream/Real-time processing), ELT/ETL and Hadoop.

JOB DESCRIPTIONJob OverviewWe are looking for a Data Scientist who will support our product, sales, leadership and marketing teamswith insights gained from analyzing company data. The ideal candidate is adept at using large data setsto find opportunities for product and process optimization and using models to test the effectiveness ofdifferent courses of action. They must have a proven ability to drive business results with theirdata-based insights. They must be comfortable working with a wide range of stakeholders andfunctional teams. The right candidate will have a passion for discovering solutions hidden in large datasets and working with stakeholders to improve business outcomes.Responsibilities for Data Scientist Work with stakeholders throughout the organization to identify opportunities for leveragingcompany data to drive business solutions. Mine and analyze data from company databases to drive optimization and improvement ofproduct development, marketing techniques and business strategies. Assess the effectiveness and accuracy of new data sources and data gathering techniques. Develop custom data models and algorithms to apply to data sets. Use predictive modeling to increase and optimize customer experiences, revenue generation, adtargeting and other business outcomes. Coordinate with different functional teams to implement models and monitor outcomes. Develop processes and tools to monitor and analyze model performance and data accuracy.Qualifications for Data Scientist Strong problem solving skills with an emphasis on product development. Experience using statistical computer languages , to manipulate data and draw insights fromlarge data sets. Experience working with and creating data architectures. Knowledge of advanced statistical techniques and concepts (regression, properties ofdistributions, statistical tests and proper usage, etc.) and experience with applications. Excellent written and verbal communication

Having good knowledge about Data Modeling in BQ+Python+Kubernetes

Hiring for Enterprise ArchitectJob Description: Develops migration strategies, solution designs, and collaborates or executable project plans Comprehends the client's business problem, need, or opportunities into solution design addressing the business problems, needs, and opportunities Ability to provide architectural direction for multiple medium to large-sized projects concurrently in various stages of their life cycle or a large project full time Ability to comprehend the client's business problem, need, or opportunity and to design a strategy/solution that completely and correctly addresses the business problem, need, or opportunity Ability to validate/evaluate if an Information System or Operational Architecture meets business needs Relates risks and challenges the client should expect to encounter with a given strategy/solution with other client efforts or projects (use of internal knowledge of organisation; trusted advisory relationship). Develops Architecture Specification deliverable that map customer business requirements into complete information systems (technologies, processes, and people) or operational solutions Ability to apply knowledge of how the industry uses IT to address business challenges using, for example, technical standards and infrastructure, cross-industry trends that impact IT investment, industry-specific roadmaps, and IT enablers Ability to establish a leadership role in business development activities for large, complex opportunities as Solution Architect Build rapport and trust internally within and externally with the client's Demonstrate excellent consultative, technical, and leadership skills Ability to strategically consider all sides of an issue within the contexts of time, breadth, and range of options Ability to systematically gather, assess and apply critical organisational, technical, operational, and sales/marketing information for business decisions

I require a person to assist us with a Data Science Udemy Course. If the person has the training videos ready, it's the best. If not, the person should be willing to create a course. The person has to create the full course.To Apply please go to GerardYadGG LinkedIn's Page, you will find the website link there, you can apply there. Please apply there to be considered.100% worldwide remote.ID PI 201

we are in the lookout for a seasoned Cloud Data Lead. We are eager to connect with you if you have extensive experience in cloud platforms, data architecture, and leadership!

Having good & strong knowledge of Data Ware House, Tableau & Power BI