This role involves developing scalable web scrapers and back-end solutions for scraping and parsing challenges, as part of a team that handles significant data traffic and serves major global clients. The position requires expertise in Python and various scraping techniques.
Scraping & Automation Jobs
209 open roles at 123 companies building scrapers, crawlers, browser automation — and the systems that stop them.
The role is for a Senior Site Reliability Engineer at a company specializing in proxy and web data scraping solutions, where the engineer will manage and evolve the production infrastructure, ensuring high availability and driving observability.
The role involves patching a Chromium-based browser and collaborating with engineers to create a stealth-focused browser for web scraping solutions. The position requires expertise in C++ and knowledge of browser fingerprinting and anti-bot techniques.
This role involves developing scalable web scrapers and back-end solutions for scraping and parsing challenges, while maintaining the existing system and implementing new features.
The role of AI Engineer involves developing and optimizing AI services to enhance productivity for a team of developers, while managing the lifecycle of these services within a large-scale infrastructure that handles significant data traffic. The position requires ownership of problem statements from design to production, focusing on creating impactful internal tools.
This role is for a hands-on Web Scraping / Crawling Engineer with 3-5 years of experience in web scraping and browser automation, responsible for designing, developing, and maintaining scalable web crawling and data extraction systems.
The role is for a Mid-Senior Backend Developer specializing in Golang at a company that provides web data scraping solutions. The developer will work on high-load systems, manage APIs, and contribute to the technical direction of projects involving significant data traffic.

Apify is seeking a Fullstack Engineer to enhance the discovery experience on their platform, focusing on search, recommendations, and categorization of web automation tools. The role involves building user-facing features and backend services to improve how users and AI agents find relevant tools.

The Product Engineer - Agent role involves building and shipping developer-facing features that enable AI agents to navigate and act on the web, focusing on creating reliable APIs that enhance developer experience.

The Product Engineer at Firecrawl will develop and deliver document-parsing features that convert various document formats into structured data for AI applications, focusing on enhancing the developer experience and ensuring high-quality output.
NationGraph is seeking a Software Engineer specializing in Data Mining to develop systems for acquiring public-sector information from the internet at scale, focusing on building and maintaining a large fleet of scrapers.
Actowiz Solutions is seeking a skilled Python Web Scraping Engineer with at least 2 years of experience to design, deploy, and maintain scalable crawling spiders for data extraction from public sources, ensuring high-volume data extraction is clean and reliable.
The role is for a Lead Product Manager at ScrapingBee, focusing on shaping the product strategy, managing the product lifecycle, and understanding developer needs to drive growth and adoption of their scraping API.
This role involves building and managing a fleet of checkout robots that verify discount codes across various e-commerce platforms, ensuring accurate and efficient automation of the checkout process.
YipitData is looking for a Web Scraping Engineer to design, build, and maintain web scrapers that support critical reports and customer experiences. The role involves tackling complex scraping challenges and collaborating with cross-functional teams to ensure efficient data ingestion processes.
The role is for a Senior Golang Developer in a team that develops advanced proxy and web data scraping solutions. The position involves designing and building backend services, working with distributed systems, and contributing to a high-scale web scraping platform.
The role is for a Senior DevOps Engineer at a company specializing in proxy and web data scraping solutions, focusing on managing and optimizing a large-scale infrastructure with significant data traffic. Responsibilities include building scalable infrastructure, implementing monitoring solutions, and contributing to continuous improvement of technical practices.

The Machine Learning Engineer at Firecrawl will develop and deploy machine learning models for search ranking and relevance, oversee A/B testing, and collaborate with engineers to optimize data pipelines and model performance in production environments.

The Cloud DevOps Engineer at Firecrawl will design, build, and operate cloud infrastructure, focusing on Kubernetes, storage, and networking to support the company's web crawling and data extraction products. The role requires extensive experience in DevOps and cloud infrastructure management.
The role of Product Owner involves bridging business requirements and technical execution for a team developing web data scraping solutions, focusing on enhancing product capabilities for B2B clients. The position requires managing product backlogs, collaborating with development teams, and translating complex technical concepts into actionable user stories.