The role is for a Senior Site Reliability Engineer at a company specializing in proxy and web data scraping solutions, where the engineer will manage and evolve the production infrastructure, ensuring high availability and driving observability.
Scraping & Automation Jobs
209 open roles at 123 companies building scrapers, crawlers, browser automation — and the systems that stop them.
The role of AI Engineer involves developing and optimizing AI services to enhance productivity for a team of developers, while managing the lifecycle of these services within a large-scale infrastructure that handles significant data traffic. The position requires ownership of problem statements from design to production, focusing on creating impactful internal tools.
The role is for a Mid-Senior Backend Developer specializing in Golang at a company that provides web data scraping solutions. The developer will work on high-load systems, manage APIs, and contribute to the technical direction of projects involving significant data traffic.

Apify is seeking a Fullstack Engineer to enhance the discovery experience on their platform, focusing on search, recommendations, and categorization of web automation tools. The role involves building user-facing features and backend services to improve how users and AI agents find relevant tools.

The Product Engineer - Agent role involves building and shipping developer-facing features that enable AI agents to navigate and act on the web, focusing on creating reliable APIs that enhance developer experience.

The Product Engineer at Firecrawl will develop and deliver document-parsing features that convert various document formats into structured data for AI applications, focusing on enhancing the developer experience and ensuring high-quality output.
The role is for a Lead Product Manager at ScrapingBee, focusing on shaping the product strategy, managing the product lifecycle, and understanding developer needs to drive growth and adoption of their scraping API.
The role is for a Senior Golang Developer in a team that develops advanced proxy and web data scraping solutions. The position involves designing and building backend services, working with distributed systems, and contributing to a high-scale web scraping platform.
The role is for a Senior DevOps Engineer at a company specializing in proxy and web data scraping solutions, focusing on managing and optimizing a large-scale infrastructure with significant data traffic. Responsibilities include building scalable infrastructure, implementing monitoring solutions, and contributing to continuous improvement of technical practices.

The Cloud DevOps Engineer at Firecrawl will design, build, and operate cloud infrastructure, focusing on Kubernetes, storage, and networking to support the company's web crawling and data extraction products. The role requires extensive experience in DevOps and cloud infrastructure management.
The role of Product Owner involves bridging business requirements and technical execution for a team developing web data scraping solutions, focusing on enhancing product capabilities for B2B clients. The position requires managing product backlogs, collaborating with development teams, and translating complex technical concepts into actionable user stories.

Apify is seeking a Team Lead for the Universe team to build and scale web scraping tools that power AI applications, while also leading a small, cross-functional team and contributing to open-source projects.
The Platform Engineering Manager role at Oxylabs involves leading a team focused on maintaining and enhancing the company's infrastructure that supports web data scraping solutions for major businesses. Responsibilities include team leadership, managing operations, and influencing DevOps practices.
The role is for a Data Analyst at a company specializing in web data scraping solutions, where the candidate will analyze customer behavior and marketing data to support business decisions, while also creating self-service dashboards and utilizing analytical tools.
The role is for a Mobile Applications Developer at a company specializing in proxy and web data scraping solutions, where the candidate will work on creating and maintaining applications across multiple platforms while contributing to technical decisions and architecture.

The Product Engineer role at Firecrawl involves building and managing the Exchange system, which enables developers to monetize data partnerships through an API. The position requires a strong engineering background with experience in production data systems and a focus on developer experience.
The role is for a Mobile Applications Developer at a company specializing in proxy and web data scraping solutions, where the candidate will work on creating and maintaining applications across multiple platforms, contributing to technical decisions and enhancing user experience.
The Senior Analytics Engineer role involves bridging engineering infrastructure and commercial decision-making, focusing on data modeling and automation to derive actionable insights from large datasets. The position requires advanced skills in dbt, SQL, and Python, and offers the opportunity to work with a team on scalable data solutions for a leading web data scraping company.
The Senior Data Acquisition & Automation Specialist will take ownership of data collection engines and automation pipelines, focusing on building and maintaining data extraction infrastructure while leading a future team. The role involves advanced data extraction using web scraping and AI integration.
The role involves developing complex data products, maintaining infrastructure, and handling large datasets while collaborating with cross-functional teams to understand customer needs and market trends.
The role is for a Lead Backend Developer at Oxylabs, focusing on leading a Dashboard squad while being hands-on in coding, particularly using PHP and Symfony. The position involves designing scalable systems, driving architecture decisions, and mentoring engineers during a significant architecture migration.
The Automation Engineer at Datawords will develop, maintain, and optimize web scraping and automation solutions using Python tools, collaborating with cross-functional teams to ensure project goals are met.
The role of Ecom Squad Lead involves leading a team responsible for delivering data solutions for AI, e-commerce, and advertising companies, while ensuring operational excellence and mentoring the next generation of scraping engineers.
The Head of Data, Analytics & AI will lead a multi-disciplinary team focused on data engineering and analytics, ensuring the data function supports business needs and drives competitive advantage through analytics and AI strategies.

The Research Engineer - Evals role involves designing evaluation systems to measure the effectiveness of Firecrawl's data extraction capabilities across various websites, formats, and edge cases, while also generating datasets and establishing metrics for quality assessment.

The Backend Infrastructure Engineer at Firecrawl will focus on building and maintaining the infrastructure for reliable data collection, enhancing success rates against sites with aggressive defenses, and managing the proxy layer under heavy load.

The Product Engineer role at Firecrawl involves building and shipping developer-facing products that transform web data into structured formats for AI applications, focusing on reliability and user experience.

The Search Engineer role at Firecrawl involves designing and building systems for crawling, indexing, and retrieval to enhance their search product, focusing on performance and cost-efficiency at scale.
This role involves designing, developing, and maintaining back-end services and RESTful APIs using Node.js and TypeScript, while also working with PostgreSQL databases and contributing to AI-powered features for client-facing products in a data scraping company.
The role involves researching and testing AI agent tools and developer products, while maintaining a strong understanding of developer workflows and the AI tooling landscape. The position focuses on shaping the company's AI direction and ensuring product recommendations resonate with a technical audience.

Apify is seeking a Team Lead for their Universe team to build and scale web automation tools, particularly focusing on web scraping and AI integration, while leading a small team and contributing to open-source projects.
The role is for a Lead Backend Engineer who will work on developing and maintaining scalable proxy and web data scraping solutions, managing high-load APIs and big data challenges. The engineer will also mentor the development team and influence technical decision-making within a modern tech stack.
The role of GEO Specialist at Oxylabs involves enhancing the company's visibility in AI-driven search environments, focusing on execution and measurement while collaborating with various teams to improve AI discoverability and content structure. The position requires SEO fluency and a strong understanding of large language models and their implications for B2B marketing.
The role involves developing scalable web scrapers and backend solutions for scraping and parsing challenges, while maintaining the existing system and implementing new features. The team supports learning and sharing knowledge about building scrapers.
The role is for a Senior Backend Engineer who will design and build new backend services and product endpoints for a web scraping platform, focusing on high-scale solutions and utilizing AI tools in their development process.
The Head of Product & Growth will lead the launch and market positioning of a new product, focusing on growth strategies, customer acquisition, and collaboration with various teams to drive sustainable growth in a web data gathering solutions company.
The role is for a Technical Product Manager in the Data Search & AI squad, focusing on developing AI-driven search products and managing product strategy, evaluation, and customer discovery related to data querying. The position involves collaboration with cross-functional teams and requires a strong understanding of AI and machine learning.
The role involves managing the Data Product roadmap, designing multi-source datasets, and integrating machine learning capabilities while ensuring data quality from a customer perspective. The position requires strong product management skills, technical fluency, and collaboration with cross-functional teams.
The role is for a Product Manager at Oxylabs, focusing on the development and growth of their Web Scraper API product portfolio, which includes defining product vision, collaborating with engineering, and engaging with enterprise clients to enhance API usability and adoption.
The role is for a Product Manager at Oxylabs, focusing on developing AI-native products and exploring new opportunities in the AI landscape. The position involves creating new product concepts, driving AI product strategy, and ensuring that AI capabilities address real user problems.

Apify is seeking a backend developer to join their team, responsible for running Actors, managing storage, and ensuring the deployment of applications on AWS infrastructure, while collaborating with a cross-functional team.
Car Info Nordic AB is seeking a high-level PHP developer to take ownership of external data flows, drive scraping efforts, and develop the engine behind their data platform, focusing on automating the retrieval, processing, and structuring of large amounts of information from various sources and APIs.
Car.info is seeking a high-level PHP developer to take ownership of external data flows, drive scraping initiatives, and develop the engine behind their data platform, focusing on automating the retrieval, processing, and structuring of large amounts of information from various sources and APIs.
Deepki is seeking a Software Engineer to develop and maintain their data collection platform, ensuring reliable and automated data consumption for clients. The role involves working with a multidisciplinary team to optimize data pipelines and enhance the overall system architecture.
This role involves contributing to the development and maintenance of a fleet of web crawlers for automated large-scale data collection, as well as participating in the migration of the existing ecosystem to a new Python-based platform using Scrapy.
The role involves building and operating large-scale data ingestion systems for AI model training, focusing on web crawling and data extraction, while collaborating with researchers to enhance model performance.
iCapital is seeking an experienced Python Developer to design and implement advanced web scraping solutions using tools like Playwright and AWS. The role involves automating interactions with complex web applications and managing scalable scraping tasks.
The Data Engineer I role at Dun & Bradstreet involves supporting Research and Managed Services through coding, automation, and operational tasks, while evaluating data sources for AI workflows.
Plaud Inc. is seeking an AI Workflow Engineer to build automated content/data pipelines and implement technical SEO strategies, focusing on enhancing human-AI interaction through innovative technologies.
This role involves building and maintaining web crawlers and data systems that support pricing intelligence for major retail and e-commerce brands. The position requires collaboration with DevOps and customer success teams to ensure the stability and accuracy of data pipelines.
The role involves serving as a Senior Security Researcher & Browser Reverse Engineer, focusing on deep technical research and reverse engineering of modern web architectures and anti-bot mechanisms. Responsibilities include analyzing complex JavaScript engines and designing resilient data extraction techniques.
The role involves reverse engineering and decompilation of web and mobile applications to enhance data extraction methods and overcome anti-bot mechanisms. The candidate will develop custom tools and implement stealthy scraping techniques to maintain operational discretion.
Dynamo Software is seeking an Automation Developer to join their Python + AI automation team, focusing on building and maintaining financial data automation, including web automation and ETL pipelines.
iCapital is seeking an experienced Python Developer to design and implement advanced web scraping solutions using tools like Playwright and AWS. The role involves automating interactions with complex web applications and managing scalable scraping tasks.
The role is for an experienced Python Developer specializing in web scraping and automated portal interactions, primarily using AWS and Playwright. Responsibilities include designing and implementing advanced scraping solutions and managing complex workflows across various data sources.
iCapital is looking for an Associate Python Developer to join their Core Operations Technology team, focusing on developing and maintaining Python-based applications while collaborating with senior developers and cross-functional teams.
Lexroom is seeking a Junior Software Engineer to design, develop, and maintain web scrapers and backend systems for their legal AI product, collaborating closely with legal engineers to meet domain-specific needs.
This role involves developing autonomous testing infrastructure for interactive digital worlds, focusing on building AI agents that can perform actions in various environments while ensuring reliability and performance.
Appmax is seeking an AI and Automation Developer to create intelligent solutions and advanced automations integrated into their ecosystem. The role involves designing, developing, and evolving AI agents, integrations, and automations using technologies like Python and APIs.
Sii Group Colombia is seeking a Web Scraper Developer for an international project, responsible for designing and maintaining large-scale data extraction solutions, developing backend systems in Java and Node.js, and implementing evasion mechanisms against blocks.