Your personal AI career agent
Senior Data Scraping Engineer - Python(m/w/x)
Web extraction with Apify and OpenRouter for AI projects. Python web scraping, dynamic content, and API handling experience required. Performance-based bonus programs.
Requirements
- At least 3 years of relevant experience in data engineering, web scraping, automation, or software development
- Bachelor's or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields
- Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
- Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
- Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
- Hands-on experience with LLMs and AI frameworks to enhance automation and problem-solving
- Strong attention to detail and commitment to data accuracy
- Self-directed work ethic with ability to troubleshoot independently
- Link to GitHub
- English proficiency: Upper-intermediate (B2) or above
Tasks
- Collaborate with Tendem Agents on repetitive tasks
- Provide critical thinking and domain expertise
- Ensure quality control for accurate results
- Handle data scraping tasks with technical precision
- Utilize Apify and OpenRouter for web extraction
- Own end-to-end data extraction workflows
- Ensure complete coverage and accuracy of datasets
- Accelerate data collection and validation
- Adapt approaches for JavaScript-rendered content
- Handle changing site behavior
- Enforce data quality standards
- Conduct validation checks and cross-source consistency
- Adhere to formatting specifications
- Verify data systematically before delivery
- Scale scraping operations for large datasets
- Use efficient batching or parallelization
- Monitor and maintain stability against site changes
Work Experience
- 3 years
Education
- Bachelor's degreeOR
- Master's degree
Languages
- English – Business Fluent
Tools & Technologies
- Python
- BeautifulSoup
- Selenium
- JS
- AJAX
- APIs
- CSV
- JSON
- Google Sheets
- LLMs
- AI frameworks
- GitHub
Benefits
Bonuses & Incentives
- Performance-based bonus programs
Like this job?
BetaYour Career Agent finds similar jobs for you every day.
Not a perfect match?
- MindriftPart-timeFreelanceRemoteExperiencedStuttgartfrom USD 32 / hour
- Mindrift
Freelance n8n Workflow Developer - AI Trainer(m/w/x)
Part-timeFreelanceRemoteExperiencedStuttgartfrom USD 60 / hour - Mindrift
Low-Code Automation Engineer - Freelance AI Trainer(m/w/x)
Part-timeFreelanceRemoteExperiencedStuttgartfrom USD 60 / hour - Mindrift
Integration Developer (API Specialist) - Freelance AI Trainer(m/w/x)
Part-timeFreelanceRemoteExperiencedStuttgartfrom USD 60 / hour - Mindrift
AI Workflow Engineer - Freelance AI Trainer(m/w/x)
Part-timeFreelanceRemoteExperiencedStuttgart
Senior Data Scraping Engineer - Python(m/w/x)
Web extraction with Apify and OpenRouter for AI projects. Python web scraping, dynamic content, and API handling experience required. Performance-based bonus programs.
Requirements
- At least 3 years of relevant experience in data engineering, web scraping, automation, or software development
- Bachelor's or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields
- Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies
- Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML)
- Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets)
- Hands-on experience with LLMs and AI frameworks to enhance automation and problem-solving
- Strong attention to detail and commitment to data accuracy
- Self-directed work ethic with ability to troubleshoot independently
- Link to GitHub
- English proficiency: Upper-intermediate (B2) or above
Tasks
- Collaborate with Tendem Agents on repetitive tasks
- Provide critical thinking and domain expertise
- Ensure quality control for accurate results
- Handle data scraping tasks with technical precision
- Utilize Apify and OpenRouter for web extraction
- Own end-to-end data extraction workflows
- Ensure complete coverage and accuracy of datasets
- Accelerate data collection and validation
- Adapt approaches for JavaScript-rendered content
- Handle changing site behavior
- Enforce data quality standards
- Conduct validation checks and cross-source consistency
- Adhere to formatting specifications
- Verify data systematically before delivery
- Scale scraping operations for large datasets
- Use efficient batching or parallelization
- Monitor and maintain stability against site changes
Work Experience
- 3 years
Education
- Bachelor's degreeOR
- Master's degree
Languages
- English – Business Fluent
Tools & Technologies
- Python
- BeautifulSoup
- Selenium
- JS
- AJAX
- APIs
- CSV
- JSON
- Google Sheets
- LLMs
- AI frameworks
- GitHub
Benefits
Bonuses & Incentives
- Performance-based bonus programs
Like this job?
BetaYour Career Agent finds similar jobs for you every day.
About the Company
Mindrift
Industry
IT
Description
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.
Not a perfect match?
- Mindrift
Freelance Data Scraping Engineer - Python(m/w/x)
Part-timeFreelanceRemoteExperiencedStuttgartfrom USD 32 / hour - Mindrift
Freelance n8n Workflow Developer - AI Trainer(m/w/x)
Part-timeFreelanceRemoteExperiencedStuttgartfrom USD 60 / hour - Mindrift
Low-Code Automation Engineer - Freelance AI Trainer(m/w/x)
Part-timeFreelanceRemoteExperiencedStuttgartfrom USD 60 / hour - Mindrift
Integration Developer (API Specialist) - Freelance AI Trainer(m/w/x)
Part-timeFreelanceRemoteExperiencedStuttgartfrom USD 60 / hour - Mindrift
AI Workflow Engineer - Freelance AI Trainer(m/w/x)
Part-timeFreelanceRemoteExperiencedStuttgart