Data Engineer- Python

Gigmos

Desired candidate profile:

Design, develop, and maintain web scraping scripts using Python.

Use web scraping libraries like Beautiful Soup, Scrapy, Selenium and other scraping tools to extract data from websites.

Write reusable, testable, and efficient code to extract structured and unstructured data.

Develop and maintain software documentation for web scraping scripts.

Collaborate with other software developers, data scientists, and other stakeholders to plan, design, develop, and launch new web scraping projects.

Troubleshoot, debug, and optimize web scraping scripts.

Stay up-to-date with the latest industry trends and technologies in automated data collection and cleaning

Help maintain code quality and organization of projects

Participate in code reviews and ensure that all solutions are aligned with standards.

Create automated test cases to ensure the functionality and performance of the code

Integration of data storage solutions like SQL/NoSQL databases, message brokers, and data streams for storing and analyzing the scraped data.

Experience with Python development and web scraping techniques.

Familiarity with web frameworks such as Django and Flask, as well as other technologies like SQL, Git, and Linux, is also required.

Strong analytical and problem-solving skills, as well as good communication and teamwork abilities, are also important for the role.

Experience : 3 - 9 Years

No. of Openings : 1

Education : B.C.A, B.Sc, B.Tech/B.E

Role : Data Engineer

Industry Type : IT-Hardware & Networking / IT-Software / Software Services

Gender : [ Male / Female ]

Job Country : India