Data Engineer – Python

Description of services

1. Design, develop, and maintain Python scripts for web scraping and data collection from target websites.
2. Extract relevant product data including title, price, rating, availability, and listing position.
3. Implement scraping solutions using libraries like BeautifulSoup, Scrapy, Selenium, or Playwright.
4. Store and manage extracted data in structured formats (e.g., CSV, JSON, SQL, NoSQL).
5. Create dashboards or reports to visualize product performance and positioning.
6. Monitor and adapt to changes in website structure to ensure scraping continuity.
7. Ensure all scraping activities comply with legal and ethical guidelines.

Qualifications

1. Bachelor’s degree in computer science, engineering, or a related field.
2. 2 years proven work experience in similar role.
3. Proficiency in Python with a focus on data scraping and automation.
4. Strong experience with web scraping frameworks (e.g., Scrapy, BeautifulSoup, Selenium).
5. Experience working with APIs and handling authentication (e.g., OAuth, tokens).
6. Hands-on experience designing and implementing AI agents or autonomous systems using Python and related frameworks.
7. Knowledge of data storage systems like MySQL, PostgreSQL / MongoDB.
8. Ability to write clean, scalable, and well-documented code.
9. Basic understanding of SEO and product ranking mechanisms is a plus.

Preferred qualifications

1. Experience with e-commerce platforms like Amazon, eBay, or Shopify.

Competitive salary, negotiable based on experience and qualifications.

When applying

CVs should be submitted, with the applied position mentioned in the subject line.