PySpark Developer

Sadup Softech Pvt Ltd

Professional experience with a cloud platform

Developer must have sound knowledge in Apache Spark and Python programming.

Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.

Ability to design, build and unit test the application in Spark/Pyspark.

In-depth knowledge of Hadoop, Spark, and similar frameworks.

Ability to understand existing ETL & logic to convert into Spark/PySpark/ Spark SQL.

Knowledge of Unix shell scripting, RDBMS, Hive, HDFS File System, HDFS File Types, HDFS compression codec.

Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.

Experience : 4 - 10 Years

No. of Openings : 1

Education : Any Bachelor Degree

Role : PySpark Developer

Industry Type : IT-Hardware & Networking / IT-Software / Software Services

Gender : [ Male / Female ]

Job Country : India