About Company:
It is a Los Angeles AWS Advanced Consulting Partner with Big Data, EMR and Redshift competency. Agilisium exists to help organizations accelerate their “Data-to-Insights-Leap”. To this end, company has invested in all stages of data journey: Data Architecture Consulting, Data Integration, Data Storage, Data Governance and Data Analytics. With advanced Design Thinking capabilities, a thriving Partner Eco-system and top-notch industry certifications, it is inherently vested in our clients’ success.
Requirements
· In depth understanding and knowledge on distributed computing with spark.
· Deep understanding of Spark Architecture and internals
· Proven experience in data ingestion, data integration and data analytics with spark, preferably PySpark.
· Expertise in ETL processes, data warehousing and data lakes.
· Hands on with python for Big data and analytics.
· Hands on in agile scrum model is an added advantage.
· Knowledge on CI/CD and orchestration tools is desirable.
· AWS S3, Redshift, Lambda knowledge is preferred