Senior Python Data Scraping Engineer

Home > Python programming jobs

Senior Python Data Scraping Engineer in Remote new

Mindrift
Full time
Email

Remote
10/04/2026
Report

Costa Rica

Responsibilities

Own end-to-end data extraction workflows across complex websites and deliver accurate, structured datasets.
Use Python scraping tools and custom workflows to collect, validate, normalize, and process data.
Extract information from JavaScript-rendered and interactive sources, adapting to changing site behavior and dynamic structures.
Handle anti-bot mechanisms and maintain reliable extraction at scale.
Apply validation, formatting, cross-source consistency checks, and systematic verification to ensure data quality.
Scale scraping operations through efficient batching or parallelization, monitor failures, and maintain stability against minor site changes.

Requirements

At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
Strong experience with Python web scraping, including BeautifulSoup, Selenium or similar tools, dynamic content, and APIs via proxies.
Experience extracting data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
Experience with data cleaning, normalization, validation, and delivery in structured formats such as CSV, JSON, and Google Sheets.
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
Experience with AWS or equivalent cloud infrastructure and Docker containerization.
Hands-on experience with LLM frameworks such as LangChain and OpenRouter for automation tasks.
English proficiency at Upper-intermediate (B2) level or above.
A GitHub link is a plus; a relevant bachelor's or master's degree is also a plus.

Benefits

Remote freelance, part-time project opportunity.
Estimated workload of approximately 10–20 hours per week during active project phases, with no guaranteed workload.
Compensation of up to $25 per hour equivalent, depending on level and pace of contribution.

Mindrift

Mindrift connects specialists with project-based AI opportunities at leading tech companies, enabling them to test, evaluate, and enhance AI systems. With a flexible freelance model, experts can earn competitive rates while contributing to innovative AI development.

Similar positions

Graduate Software Engineer

Synack
Full time

UK
10/04/2026

Remote

Software Engineer - Cloud Images

Canonical
Full time

Remote
10/04/2026

EMEA, Americas

GTM Engineer

Higgsfield
Full time

USA
10/04/2026
Salary: $130k - $175k/yr

San Francisco, CA

Research Engineer

Clera
Full time

Others
10/04/2026

Zürich, Switzerland

Lead Automation Quality Engineer

London Stock Exchange Group
Full time

Others
10/04/2026
Salary: Competitive

Bengaluru, India