Senior Python Data Scraping Engineer

Home > Javascript/Typescript programming jobs

Senior Python Data Scraping Engineer in USA

Mindrift
Full time
Email

USA
09/23/2026
Report

Remote

Responsibilities

Own end-to-end data extraction workflows across complex websites and deliver accurate structured datasets.
Use custom workflows and technical tools to accelerate data collection, validation, and task execution.
Extract data from dynamic and interactive sources, including JavaScript-rendered content, while adapting to changing site behavior.
Apply validation checks, cross-source consistency controls, formatting standards, and systematic verification to ensure data quality.
Scale scraping operations through efficient batching or parallelization, monitor failures, and maintain stability against site structure changes.

Requirements

At least 5 years of relevant experience in data engineering, web scraping, automation, or software development.
Strong Python web scraping experience with BeautifulSoup, Selenium or similar tools, including dynamic content and APIs via proxies.
Ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
Experience with data cleaning, normalization, and validation, delivering structured datasets in CSV, JSON, or Google Sheets.
Experience handling anti-bot mechanisms and dynamic site structures at scale.
Experience with AWS or equivalent cloud infrastructure and Docker containerization.
Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
Upper-intermediate English proficiency at B2 level or above.
A bachelor's or master's degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
A GitHub link is a plus.

Benefits

Remote freelance work with an estimated 10–20 hours per week during active project phases.
Part-time project engagement with workload dependent on project requirements and active phases.

Mindrift

Mindrift connects specialists with project-based AI opportunities at leading tech companies, enabling them to test, evaluate, and enhance AI systems. With a flexible freelance model, experts can earn competitive rates while contributing to innovative AI development.

Similar positions

Senior Software Developer - Applications

Learntastic
Full time

USA
10/26/2026

Remote

Frontend Software Engineer

Sumundi
Contract

Remote
10/26/2026

Ghana

Software Development Engineer II

Mapbox
Full time

UK
10/26/2026

Remote

Senior Platform Engineer

Clera
Full time

Others
10/26/2026

Munich, Germany

Senior Software Engineer - Full Stack

Bankjoy
Full time

Canada
10/25/2026
Salary: Competitive

Remote