PySpark Developer

• Professional experience with a cloud platform

• Developer must have sound knowledge in Apache Spark and Python programming.

• Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.

• Ability to design, build and unit test the application in Spark/Pyspark.

• In-depth knowledge of Hadoop, Spark, and similar frameworks.

• Ability to understand existing ETL & logic to convert into Spark/PySpark/ Spark SQL.

• Knowledge of Unix shell scripting, RDBMS, Hive, HDFS File System, HDFS File Types, HDFS compression codec.

• Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.

• Experience

  4 - 10 Years

• No. of Openings

  1

• Education

  Graduate

• Role

  PySpark Developer

• Industry Type

  IT-Hardware & Networking

• Gender

  [ Male / Female ]

• Job Country

  India

• Type of Job

  Full Time

• Work Location Type

  Work from Office