Looking For SR. Big Data Engineer

DevLats Pvt Ltd

sr. big data engineer

location: pune

experience: 10+ years

mode: hybrid

role overview:

we are seeking a talented sr. big data engineer to design, develop, and support a highly scalable, distributed saas-based security risk prioritization product. you will lead the design and evolution of our data platform and pipelines, providing technical leadership to a team of engineers and architects.

key responsibilities:

• provide technical leadership on data platform design, roadmaps, and architecture.

• design and implement scalable architecture for big data and microservices environments.

• drive technology explorations, leveraging knowledge of internal and industry prior art.

• ensure quality architecture and design of systems, focusing on performance, scalability, and security.

• mentor and provide technical guidance to other engineers.

required skills & technologies:

• mandatory: kafka, scala, spark.

• big data & data streaming: spark, kafka, hadoop, presto, airflow, data lakes, lambda architecture, kappa, and kappa ++ architectures with flink data streaming.

• databases & caching: rdbms, nosql, oracle, cassandra, redis.

• search solutions: solr, elastic.

• ml & automation: experience with ml models engineering and related deployment, scripting, and automation.

• architecture: in-depth experience with messaging queues and caching components.

• other skills: strong troubleshooting and performance benchmarking skills for big data technologies.

qualifications:

• bachelor’s degree in computer science or equivalent.

• 8+ years of total experience, with 6+ years relevant.

• 2+ years in designing big data solutions with spark.

• 3+ years with kafka and performance testing for large infrastructure.

• Experience

  8 - 10 Years

• No. of Openings

  5

• Education

  B.Sc, Any Bachelor Degree, M.Sc

• Role

  Big Data Engineer

• Industry Type

  IT-Hardware & Networking / IT-Software / Software Services

• Gender

  [ Male / Female ]

• Job Country

  India

• Type of Job

  Full Time

• Work Location Type

  Work from Office