This role involves developing scalable web scrapers and back-end solutions for scraping and parsing challenges, as part of a team that handles significant data traffic and serves major global clients. The position requires expertise in Python and various scraping techniques.
Scraping & Automation Jobs
209 open roles at 123 companies building scrapers, crawlers, browser automation — and the systems that stop them.
The role is for a Senior Site Reliability Engineer at a company specializing in proxy and web data scraping solutions, where the engineer will manage and evolve the production infrastructure, ensuring high availability and driving observability.
The role involves patching a Chromium-based browser and collaborating with engineers to create a stealth-focused browser for web scraping solutions. The position requires expertise in C++ and knowledge of browser fingerprinting and anti-bot techniques.
This role involves developing scalable web scrapers and back-end solutions for scraping and parsing challenges, while maintaining the existing system and implementing new features.
The role of AI Engineer involves developing and optimizing AI services to enhance productivity for a team of developers, while managing the lifecycle of these services within a large-scale infrastructure that handles significant data traffic. The position requires ownership of problem statements from design to production, focusing on creating impactful internal tools.
This role is for a hands-on Web Scraping / Crawling Engineer with 3-5 years of experience in web scraping and browser automation, responsible for designing, developing, and maintaining scalable web crawling and data extraction systems.
The role is for a Mid-Senior Backend Developer specializing in Golang at a company that provides web data scraping solutions. The developer will work on high-load systems, manage APIs, and contribute to the technical direction of projects involving significant data traffic.

Apify is seeking a Fullstack Engineer to enhance the discovery experience on their platform, focusing on search, recommendations, and categorization of web automation tools. The role involves building user-facing features and backend services to improve how users and AI agents find relevant tools.

The Product Engineer - Agent role involves building and shipping developer-facing features that enable AI agents to navigate and act on the web, focusing on creating reliable APIs that enhance developer experience.

The Product Engineer at Firecrawl will develop and deliver document-parsing features that convert various document formats into structured data for AI applications, focusing on enhancing the developer experience and ensuring high-quality output.
NationGraph is seeking a Software Engineer specializing in Data Mining to develop systems for acquiring public-sector information from the internet at scale, focusing on building and maintaining a large fleet of scrapers.
Actowiz Solutions is seeking a skilled Python Web Scraping Engineer with at least 2 years of experience to design, deploy, and maintain scalable crawling spiders for data extraction from public sources, ensuring high-volume data extraction is clean and reliable.
The role is for a Lead Product Manager at ScrapingBee, focusing on shaping the product strategy, managing the product lifecycle, and understanding developer needs to drive growth and adoption of their scraping API.
This role involves building and managing a fleet of checkout robots that verify discount codes across various e-commerce platforms, ensuring accurate and efficient automation of the checkout process.
YipitData is looking for a Web Scraping Engineer to design, build, and maintain web scrapers that support critical reports and customer experiences. The role involves tackling complex scraping challenges and collaborating with cross-functional teams to ensure efficient data ingestion processes.
The role is for a Senior Golang Developer in a team that develops advanced proxy and web data scraping solutions. The position involves designing and building backend services, working with distributed systems, and contributing to a high-scale web scraping platform.
The role is for a Senior DevOps Engineer at a company specializing in proxy and web data scraping solutions, focusing on managing and optimizing a large-scale infrastructure with significant data traffic. Responsibilities include building scalable infrastructure, implementing monitoring solutions, and contributing to continuous improvement of technical practices.

The Machine Learning Engineer at Firecrawl will develop and deploy machine learning models for search ranking and relevance, oversee A/B testing, and collaborate with engineers to optimize data pipelines and model performance in production environments.

The Cloud DevOps Engineer at Firecrawl will design, build, and operate cloud infrastructure, focusing on Kubernetes, storage, and networking to support the company's web crawling and data extraction products. The role requires extensive experience in DevOps and cloud infrastructure management.
The role of Product Owner involves bridging business requirements and technical execution for a team developing web data scraping solutions, focusing on enhancing product capabilities for B2B clients. The position requires managing product backlogs, collaborating with development teams, and translating complex technical concepts into actionable user stories.
Wise is seeking a Senior Backend Engineer to develop and scale their price comparison platform, focusing on building robust scrapers and data pipelines to enhance competitive intelligence and data quality.
Mindrift is seeking a Python Data Scraping Engineer to work on the Tendem project, focusing on web scraping, data extraction, and processing to deliver high-quality datasets. This part-time remote role requires expertise in handling complex data workflows and ensuring data accuracy.
This role seeks an experienced Data Scraping Expert to collect large volumes of accurate business and contact data, primarily through data scraping techniques, while managing CRM and lead management as secondary tasks, at Reality Marble, a small investment-management team focused on backing the creator economy.
Mindrift is seeking a Senior Python Data Scraping Engineer to work on the Tendem project, focusing on web scraping, data extraction, and processing to deliver high-quality datasets from complex websites. This part-time remote role requires expertise in handling dynamic content and ensuring data accuracy.

Apify is seeking a Team Lead for the Universe team to build and scale web scraping tools that power AI applications, while also leading a small, cross-functional team and contributing to open-source projects.
The Platform Engineering Manager role at Oxylabs involves leading a team focused on maintaining and enhancing the company's infrastructure that supports web data scraping solutions for major businesses. Responsibilities include team leadership, managing operations, and influencing DevOps practices.
The role is for a Data Analyst at a company specializing in web data scraping solutions, where the candidate will analyze customer behavior and marketing data to support business decisions, while also creating self-service dashboards and utilizing analytical tools.
The role is for a Mobile Applications Developer at a company specializing in proxy and web data scraping solutions, where the candidate will work on creating and maintaining applications across multiple platforms while contributing to technical decisions and architecture.
The role involves reverse engineering anti-bot and fingerprinting systems, building automation tools and pipelines, and leveraging AI to enhance data extraction processes at Zyte.

The Product Engineer role at Firecrawl involves building and managing the Exchange system, which enables developers to monetize data partnerships through an API. The position requires a strong engineering background with experience in production data systems and a focus on developer experience.
The role is for a Mobile Applications Developer at a company specializing in proxy and web data scraping solutions, where the candidate will work on creating and maintaining applications across multiple platforms, contributing to technical decisions and enhancing user experience.
The Technical Content Specialist at ScrapingBee will manage the blog and website content pipeline, ensuring technical accuracy and clarity while collaborating with various teams to enhance the company's content operations and authority in the developer community.
The Senior Analytics Engineer role involves bridging engineering infrastructure and commercial decision-making, focusing on data modeling and automation to derive actionable insights from large datasets. The position requires advanced skills in dbt, SQL, and Python, and offers the opportunity to work with a team on scalable data solutions for a leading web data scraping company.
The Senior Web Scraping Engineer will be responsible for the reliability of a large-scale web data acquisition pipeline, ensuring system uptime and building resilient infrastructure to bypass anti-bot protections. The role requires proactive improvements and expertise in web scraping technologies.

The Success Engineer at Firecrawl is responsible for ensuring customer success by deepening product usage, solving technical issues, and managing account health throughout the customer lifecycle. This role requires a blend of technical expertise and customer-facing skills to drive adoption and expansion of the company's AI-driven data extraction solutions.

The Implementation Specialist at Firecrawl is responsible for onboarding customers by integrating their systems with Firecrawl's API, ensuring a smooth transition from purchase to production. This hands-on, customer-facing role requires technical expertise to diagnose issues and facilitate successful product launches.

The Sales Engineer at Firecrawl will act as a technical partner in the sales process, demonstrating the product's capabilities, architecting solutions, and addressing technical inquiries to facilitate deals. This role requires a blend of technical expertise and commercial acumen, reporting directly to the VP of Deployment.

The Forward Deployed Engineer at Firecrawl is responsible for integrating the company's web data extraction solutions into customer environments, addressing technical challenges, and ensuring successful adoption of the product. This role requires hands-on technical skills and customer-facing experience to drive product usage and expansion.
The Senior Data Acquisition & Automation Specialist will take ownership of data collection engines and automation pipelines, focusing on building and maintaining data extraction infrastructure while leading a future team. The role involves advanced data extraction using web scraping and AI integration.
The role involves designing and developing scalable web scraping systems for large-scale data extraction and brand protection, ensuring data quality and governance, and optimizing performance and reliability of scraping systems.
This role involves developing and maintaining asynchronous web crawlers and backend services using Rust, while ensuring the stability and adaptability of crawlers for authorized data sources. Responsibilities include handling pagination, rate limiting, retries, task scheduling, and data integrity issues.
The role involves developing complex data products, maintaining infrastructure, and handling large datasets while collaborating with cross-functional teams to understand customer needs and market trends.
The role is for a Lead Backend Developer at Oxylabs, focusing on leading a Dashboard squad while being hands-on in coding, particularly using PHP and Symfony. The position involves designing scalable systems, driving architecture decisions, and mentoring engineers during a significant architecture migration.
The Automation Engineer at Datawords will develop, maintain, and optimize web scraping and automation solutions using Python tools, collaborating with cross-functional teams to ensure project goals are met.
The role of Ecom Squad Lead involves leading a team responsible for delivering data solutions for AI, e-commerce, and advertising companies, while ensuring operational excellence and mentoring the next generation of scraping engineers.
The Head of Data, Analytics & AI will lead a multi-disciplinary team focused on data engineering and analytics, ensuring the data function supports business needs and drives competitive advantage through analytics and AI strategies.

The Senior Software Engineer at Firecrawl will be responsible for developing the monetization funnel, including pricing, plans, and conversion strategies, while leveraging full-stack engineering skills to drive revenue growth.

The Research Engineer - Evals role involves designing evaluation systems to measure the effectiveness of Firecrawl's data extraction capabilities across various websites, formats, and edge cases, while also generating datasets and establishing metrics for quality assessment.

The Backend Infrastructure Engineer at Firecrawl will focus on building and maintaining the infrastructure for reliable data collection, enhancing success rates against sites with aggressive defenses, and managing the proxy layer under heavy load.

The Product Engineer role at Firecrawl involves building and shipping developer-facing products that transform web data into structured formats for AI applications, focusing on reliability and user experience.

The Search Engineer role at Firecrawl involves designing and building systems for crawling, indexing, and retrieval to enhance their search product, focusing on performance and cost-efficiency at scale.
This role involves designing, developing, and maintaining back-end services and RESTful APIs using Node.js and TypeScript, while also working with PostgreSQL databases and contributing to AI-powered features for client-facing products in a data scraping company.
The role involves researching and testing AI agent tools and developer products, while maintaining a strong understanding of developer workflows and the AI tooling landscape. The position focuses on shaping the company's AI direction and ensuring product recommendations resonate with a technical audience.

Apify is seeking a Team Lead for their Universe team to build and scale web automation tools, particularly focusing on web scraping and AI integration, while leading a small team and contributing to open-source projects.
The role is for a Lead Backend Engineer who will work on developing and maintaining scalable proxy and web data scraping solutions, managing high-load APIs and big data challenges. The engineer will also mentor the development team and influence technical decision-making within a modern tech stack.
SearchApi is seeking a Ruby Engineer with expertise in browser automation and anti-bot evasion to develop and maintain their SERP API, which delivers structured data from various search engines. The role involves fixing parsers, building new integrations, and directly interacting with customers.
This role involves researching and implementing anti-bot evasion techniques, reverse engineering bot detection systems, and optimizing configurations for stealth in web scraping. The engineer will work on complex technical challenges related to bypassing protections and improving the company's scraping capabilities.
The role involves researching and implementing anti-bot evasion techniques, reverse engineering bot detection systems, and working with browser fingerprinting to bypass protections. The position is highly technical and requires deep expertise in web scraping and anti-bot technologies.
The role of GEO Specialist at Oxylabs involves enhancing the company's visibility in AI-driven search environments, focusing on execution and measurement while collaborating with various teams to improve AI discoverability and content structure. The position requires SEO fluency and a strong understanding of large language models and their implications for B2B marketing.
The role involves developing scalable web scrapers and backend solutions for scraping and parsing challenges, while maintaining the existing system and implementing new features. The team supports learning and sharing knowledge about building scrapers.
The role is for a Senior Site Reliability Engineer at a company specializing in proxy and web data scraping solutions, focusing on maintaining and evolving their production infrastructure, including migrating to Kubernetes and ensuring high availability across services.
As a Security Researcher, you will simulate advanced adversaries against data collection products, focusing on web application security and machine learning data collection methods to enhance the Bright Data platform -- Bright Data's web-data infrastructure powers AI and business intelligence for more than 20,000 clients worldwide.
The role is for a Senior Backend Engineer who will design and build new backend services and product endpoints for a web scraping platform, focusing on high-scale solutions and utilizing AI tools in their development process.
Mercado Libre is seeking an expert in Scraping & Information Security to lead the development of resilient, privacy-first, and AI-powered systems for enhancing strategic intelligence capabilities, focusing on web data extraction and information protection.
The Head of Product & Growth will lead the launch and market positioning of a new product, focusing on growth strategies, customer acquisition, and collaboration with various teams to drive sustainable growth in a web data gathering solutions company.
The role is for a Technical Product Manager in the Data Search & AI squad, focusing on developing AI-driven search products and managing product strategy, evaluation, and customer discovery related to data querying. The position involves collaboration with cross-functional teams and requires a strong understanding of AI and machine learning.
The role involves managing the Data Product roadmap, designing multi-source datasets, and integrating machine learning capabilities while ensuring data quality from a customer perspective. The position requires strong product management skills, technical fluency, and collaboration with cross-functional teams.
The role is for a Product Manager at Oxylabs, focusing on the development and growth of their Web Scraper API product portfolio, which includes defining product vision, collaborating with engineering, and engaging with enterprise clients to enhance API usability and adoption.
The role is for a Product Manager at Oxylabs, focusing on developing AI-native products and exploring new opportunities in the AI landscape. The position involves creating new product concepts, driving AI product strategy, and ensuring that AI capabilities address real user problems.
This role seeks a highly skilled technical expert in web data extraction resilience, focusing on overcoming complex blocking challenges and ensuring reliable data extraction from dynamic web environments.

Apify is seeking a backend developer to join their team, responsible for running Actors, managing storage, and ensuring the deployment of applications on AWS infrastructure, while collaborating with a cross-functional team.
The Web Scraping Engineer role involves building, maintaining, and optimizing web scraping systems while investigating anti-bot detection systems and collaborating with product teams to address scraping failures. The ideal candidate has extensive experience in production-level scraping and a strong understanding of anti-bot techniques.
As a Senior Anti-Bot Engineer at Adthena, you will design and maintain large-scale web scraping systems focused on Google and similar platforms, addressing complex scraping challenges and ensuring data accuracy and reliability.

Exa is seeking a Web Crawler engineer to build and optimize a large-scale web crawling system capable of processing over 100 million pages per day, focusing on advanced crawling techniques and handling dynamic content.
Kpler is seeking a Data Engineer to enhance their Natural Gas product by scaling data sources, developing analytics, and maintaining data scrapers. The role involves collaboration with software engineers and market analysts to ensure data quality and performance.
The role involves hiring an Automation Developer to expand and operate a social automation and outreach platform for web3 growth, focusing on automated engagement campaigns and lead generation.
The role involves designing, developing, and maintaining internal systems and RESTful APIs, with a focus on developing advanced web scraping tools and analyzing data flows to support business decisions.
Car.info is seeking a high-level PHP developer to take ownership of external data flows, drive scraping initiatives, and develop the engine behind their data platform, focusing on automating the retrieval, processing, and structuring of large amounts of information from various sources and APIs.
This role involves data collection, structuring, and information extraction to meet data quality goals, while collaborating with various teams to improve data quality. The candidate will also explore and implement advanced technologies alongside a mentor or team leader.
Car Info Nordic AB is seeking a high-level PHP developer to take ownership of external data flows, drive scraping efforts, and develop the engine behind their data platform, focusing on automating the retrieval, processing, and structuring of large amounts of information from various sources and APIs.
The role involves architecting and maintaining data collection pipelines at scale, addressing real web complexities such as CAPTCHAs and anti-bot measures. The engineer will work closely with data and product teams to ensure timely and clean data delivery.
This role involves web data scraping, cleaning, parsing, and storage, requiring proficiency in Python and familiarity with JavaScript and FastAPI. The candidate will also work with databases and various scraping technologies, including anti-scraping techniques.
As a Data Scraping Engineer at Moojing Market Intelligence, you will design, develop, and maintain web crawlers and scrapers, collaborating with project managers and ensuring the crawler system operates smoothly.
This role involves building and operating large-scale web crawling systems to continuously collect and process content from the internet, directly impacting AI model performance, at Reflection, a research lab founded by former DeepMind, OpenAI, and Anthropic researchers working to make frontier AI open and accessible.
The role is for a Data Acquisition Engineer in the Internal Security Department, focusing on building platforms that collect and process structured data from various online sources, utilizing software engineering, browser automation, and AI.
The role involves working as a Python Developer within the scraping team, focusing on optimizing data collection through the design and implementation of robust Scrapy spiders, conducting code reviews, and developing sophisticated web crawling solutions.
Deepki is seeking a Software Engineer to develop and maintain their data collection platform, ensuring reliable and automated data consumption for clients. The role involves working with a multidisciplinary team to optimize data pipelines and enhance the overall system architecture.
The role is for a senior Back-End Software Engineer focused on building and scaling high-performance web scanning and data ingestion systems, involving the design and operation of distributed services that crawl, scrape, process, and store large volumes of web data.
This role involves contributing to the development and maintenance of a fleet of web crawlers for automated large-scale data collection, as well as participating in the migration of the existing ecosystem to a new Python-based platform using Scrapy.
The role is for a Full Stack Engineer who will design and develop scalable automation applications, focusing on web scraping and data processing, while collaborating with cross-functional teams.
OpenAI is seeking a skilled Software Engineer to join their Data Acquisition team, responsible for data collection to support model training operations, including web crawling and data ingestion.
Krawlnet Technologies is seeking a Web Scraping Engineer to design and operate web data acquisition systems, focusing on overcoming anti-bot challenges and ensuring data accuracy at scale.
The Data Engineer will build and maintain web-crawling solutions to collect high-quality data from websites, collaborating with various teams and ensuring reliable data collection through automated scripts.
The role involves building and operating large-scale data ingestion systems for AI model training, focusing on web crawling and data extraction, while collaborating with researchers to enhance model performance.
Delectatech is seeking a Data Crawler Specialist to manage and enhance their production crawling system, focusing on complex data extraction from various sources while ensuring operational efficiency and resolving daily issues.
This role involves web data scraping, cleaning, parsing, and storage, requiring proficiency in Python and familiarity with JavaScript and FastAPI. The candidate will also work with various databases and scraping technologies, including anti-scraping techniques.
McKesson is seeking a Senior Software Engineer to design, develop, and maintain complex software solutions, focusing on scalable data pipelines and web crawlers using Scrapy and Python.
iCapital is seeking an experienced Python Developer to design and implement advanced web scraping solutions using tools like Playwright and AWS. The role involves automating interactions with complex web applications and managing scalable scraping tasks.
This role involves web data scraping, cleaning, parsing, and storage, requiring proficiency in Python and familiarity with JavaScript and FastAPI. The candidate will also work with databases and various scraping technologies, including anti-scraping techniques.
The role of Competitive Intelligence Engineer involves developing solutions to extract and process data from various digital sources using technologies like Python and OCR tools. The engineer will automate data extraction processes and collaborate with teams to optimize data workflows.
The Data Engineer I role at Dun & Bradstreet involves supporting Research and Managed Services through coding, automation, and operational tasks, while evaluating data sources for AI workflows.
The role involves designing and building scalable data engineering solutions for structured and unstructured data, focusing on delivering business insights and analytics. It requires expertise in coding, data management, and building robust APIs, with a strong emphasis on problem-solving and collaboration.
The Real-World Data Collection & Scraping Engineer will build data infrastructure for robotics and machine learning systems by collecting, labeling, and processing real-world sensor data, as well as developing automated data scraping pipelines for training datasets.
This role involves building and maintaining a data collection system focused on high-value corporate data, utilizing Python and Playwright for automation and ensuring data quality and compliance with regulations.
This role involves building tools that extract data from protected public sources on the web using Python and React, with a focus on overcoming bot protection. The position requires fluency in English and the ability to demonstrate successful scraping techniques.
The role involves sourcing and organizing targeted lead lists for marketing and creator operations by compiling high-quality data sets from public online sources.
Plaud Inc. is seeking an AI Workflow Engineer to build automated content/data pipelines and implement technical SEO strategies, focusing on enhancing human-AI interaction through innovative technologies.
Alternative Path is looking for a Business Analyst specializing in web scraping to collaborate with a US-based hedge fund, focusing on delivering high-quality datasets that support investment decisions. The role involves client interaction, technical data validation, and process innovation.
As an AI Engineer at Blacksmith Agency, you will be responsible for building and shipping internal automation systems based on a documented roadmap, focusing on integrating AI technologies into workflows.
The role involves owning the data pipelines that scrape, normalize, and land transaction and listing data from external marketplaces to support real-time pricing for trading cards. Responsibilities include designing and optimizing the ingestion layer, building monitoring systems, and collaborating with various teams to ensure data quality.
The role involves leading the design and development of scalable data pipelines and enterprise-grade Python applications, with a focus on Python scripting and data processing frameworks. The candidate should have extensive experience in Python, SQL, and cloud services like AWS and Azure.
CUBE is seeking a Junior Content Capture Analyst to develop and maintain web scraping solutions for extracting structured regulatory data from HTML-based websites. The role involves collaborating with analysts and engineers to enhance data extraction processes and ensure data accuracy.
Blacksmith Agency is seeking an AI Automation Engineer to build and implement automation workflows using various frameworks and APIs, focusing on production systems rather than model training.
The intern will support the Data and Digital Division by collecting, manipulating, and analyzing data using Python, including web scraping and machine learning techniques, while also assisting in various projects and market studies.
This role is for a Full Stack JavaScript Developer who will focus on building AI-powered automation agents for enterprise customers, involving design, development, and integration of automation solutions using TypeScript and browser automation tools.
This role involves building and maintaining web crawlers and data systems that support pricing intelligence for major retail and e-commerce brands. The position requires collaboration with DevOps and customer success teams to ensure the stability and accuracy of data pipelines.
The AI Automation Engineer at BairesDev will architect scalable web scraping pipelines and build generative AI agents to automate business processes, leveraging advanced Python skills and systems integration expertise.
The role involves serving as a Senior Security Researcher & Browser Reverse Engineer, focusing on deep technical research and reverse engineering of modern web architectures and anti-bot mechanisms. Responsibilities include analyzing complex JavaScript engines and designing resilient data extraction techniques.
The role involves reverse engineering and decompilation of web and mobile applications to enhance data extraction methods and overcome anti-bot mechanisms. The candidate will develop custom tools and implement stealthy scraping techniques to maintain operational discretion.
The GTM Engineer at HyperOrbit will build systems and automation to enhance the company's go-to-market strategies, integrating engineering, sales, and AI to optimize customer engagement and revenue generation.
GPTZero is seeking software engineers to develop tools for detecting AI-generated content and to create impactful reports on AI-related issues. The role involves building data processing pipelines and utilizing AI detection models to uncover significant findings.
GPTZero is seeking software engineers to develop a research engine that identifies AI-generated content and hallucinations on the internet, contributing to impactful investigations in AI and journalism.

Exa is seeking an engineering intern to assist in building a groundbreaking search engine, focusing on large-scale machine learning systems and web crawling technologies. The role involves hands-on projects that leverage high-performance programming skills to enhance information retrieval capabilities.
The role involves building scalable data infrastructure and tools for the Teamwear business, focusing on data pipelines, algorithms, and data quality management.
The company is seeking a Senior Data Engineer to collect and integrate data from various web sources, focusing on web scraping, data quality, and ETL processes. The role involves developing scalable data processing solutions and optimizing database performance.
GlobalLogic is seeking a Software Engineer with expertise in web technologies and data extraction to develop and maintain web scrapers for automating browser interactions and ensuring high-quality data delivery for web intelligence projects -- a Hitachi Group company that's been a digital engineering partner to major brands since 2000.
The Data Acquisition Engineer will be responsible for managing the flow of external data from the internet into the company's product, focusing on data collection, structuring, and automation of data pipelines.
The D. E. Shaw group is seeking a Data Engineer to develop web robots for data extraction and automate data pipelines within their product development teams in India. The role involves managing data extraction processes, ensuring data integrity, and building monitoring systems.
REPS & Co. is looking for a Senior Fullstack Engineer to deliver high-quality software and collaborate with teammates in a fast-paced environment, focusing on data analytics in the entertainment industry.
The Data Engineer role at Tech Aalto involves designing, developing, and deploying data systems, including data extraction and web scraping as part of data processing tasks. The position requires collaboration with various stakeholders and proficiency in data engineering tools and techniques.
Mindsite is seeking a Reverse Engineer to design and build resilient web data acquisition systems, focusing on browser automation, network analysis, and scalable crawling infrastructure to support their e-commerce analytics platform.
As a Python Web Crawler & PunchOut Integration Engineer at Lio, you will build and maintain supplier integrations using web crawlers and APIs, enabling customers to access supplier catalogues and product data seamlessly.
Dynamo Software is seeking an Automation Developer to join their Python + AI automation team, focusing on building and maintaining financial data automation, including web automation and ETL pipelines.
The role involves partnering with various stakeholders to design and automate workflows, develop Python-based solutions for data processing, and create reporting tools. It also includes testing and supporting production automations.
Koladin is seeking an AI Builder to develop tools and automate workflows, focusing on software development and data analysis, particularly using Claude Code and web scraping techniques.
The role involves enhancing team efficiency through AI-driven workflow automation, data visualization, and competitive intelligence, focusing on building automation pipelines and dashboards to support higher-order work.
Cohere is seeking a Senior Member of Technical Staff to develop a large-scale web data pipeline for their advanced language models, focusing on transforming raw internet data into high-quality training data.
The role involves developing, maintaining, and evolving automation solutions with a focus on web applications, government portals, and external systems. Responsibilities include analyzing processes for automation, integrating with APIs, and managing existing automations using .NET/C#, CefSharp, and JavaScript.
Cohere is seeking a Senior Member of Technical Staff to develop a large-scale web data pipeline for their advanced language models, focusing on transforming raw internet data into high-quality training data.
Balyasny Asset Management is looking for a Senior Engineer to lead their Webscraping team, focusing on building advanced data collection systems that support investment strategies through innovative AI/ML technologies.
Cohere is seeking a Senior Member of Technical Staff specializing in web data to develop a large-scale web data pipeline for their advanced language models, focusing on transforming raw internet data into high-quality training data.
The role involves designing and building distributed scraping architectures, reverse engineering APIs and mobile apps, and leading technical innovation in scraping while collaborating with various teams to ensure high-quality data extraction.
As a Senior Python Developer on the scraping team, you will design and implement robust Scrapy spiders to optimize data collection, conduct code reviews, and develop sophisticated web crawling solutions to bypass anti-bot measures.
iCapital is seeking an experienced Python Developer to design and implement advanced web scraping solutions using tools like Playwright and AWS. The role involves automating interactions with complex web applications and managing scalable scraping tasks.
The AI Automation Engineer at BairesDev will architect scalable web scraping pipelines, orchestrate workflows using low-code/no-code platforms, and build generative AI agents to automate business processes, leveraging advanced Python skills and systems integration expertise.
The role involves building and maintaining applications for data retrieval from over 4,500 unique financial data feeds, ensuring accurate and timely data acquisition for clients. It requires collaboration with development and managed services teams to enhance data processes and workflows.
The role is for an experienced Python Developer specializing in web scraping and automated portal interactions, primarily using AWS and Playwright. Responsibilities include designing and implementing advanced scraping solutions and managing complex workflows across various data sources.
The Data Engineer role at Unison Group involves designing, developing, and deploying data structures in various data storage systems, performing data extraction and transformation, and collaborating with cross-functional teams to build scalable data-driven products. The position also includes developing backend APIs and maintaining data pipelines in an Agile environment.
The Lead AI Automation & Integration Engineer will design and deploy scalable data extraction systems and intelligent automation workflows for a market intelligence platform, focusing on integrating generative AI agents and optimizing automated processes.
The role involves building agentic AI systems for browser automation, focusing on creating reliable and scalable automation engines that interact with fragmented legacy portals. The Software Engineer will work closely with founders to shape technical direction and ensure production readiness.
The Lead AI Automation & Integration Engineer will design and deploy scalable data extraction systems and intelligent automation workflows for a market intelligence platform, utilizing Python and modern web scraping frameworks.
The role involves designing and building responsive search interfaces using Coveo technologies, integrating Coveo Cloud with enterprise systems, and managing query pipelines to optimize search results. Candidates should have extensive experience in software development and cloud-native systems.
The role involves reverse engineering and decompilation of web and mobile applications, overcoming anti-bot mechanisms, developing custom tools, and implementing stealthy scraping techniques to enhance data extraction methods.
iCapital is looking for an Associate Python Developer to join their Core Operations Technology team, focusing on developing and maintaining Python-based applications while collaborating with senior developers and cross-functional teams.
The role involves building and maintaining a proprietary technician database by acquiring and enriching data from public records across all 50 states, focusing on compliance and data hygiene.
The role involves developing, maintaining, and evolving automation robots using Python and RPA tools, analyzing business processes for automation opportunities, and creating scalable solutions. The position also includes integrating with internal and external systems via APIs and optimizing robot performance.
Censys is seeking a Staff Software Developer to design, build, and operate systems for Internet-wide scanning, DNS resolution, and data pipelines, focusing on improving the accuracy and reliability of their Internet Map.
Lexroom is seeking a Junior Software Engineer to design, develop, and maintain web scrapers and backend systems for their legal AI product, collaborating closely with legal engineers to meet domain-specific needs.
The role involves developing, maintaining, and evolving automation robots using Python and RPA tools, analyzing business processes for automation opportunities, and integrating with internal and external systems via APIs.
This role involves developing autonomous testing infrastructure for interactive digital worlds, focusing on building AI agents that can perform actions in various environments while ensuring reliability and performance.
The role involves managing incidents, troubleshooting bugs, and developing and maintaining crawlers/scrapers for efficient data capture. It also includes ensuring data quality, security, and governance, as well as integrating various data sources.
This role involves collecting, parsing, and cleaning various data for AI model training, designing and implementing distributed crawler frameworks, and developing customized scraping and anti-scraping strategies for different websites.
Appmax is seeking an AI and Automation Developer to create intelligent solutions and advanced automations integrated into their ecosystem. The role involves designing, developing, and evolving AI agents, integrations, and automations using technologies like Python and APIs.
The Data Engineer role at Activate Interactive involves designing, developing, and deploying data solutions, including data extraction and web scraping as part of data processing tasks. The position requires collaboration with various teams to build scalable data-driven products and maintain data pipelines.
The role involves building internal systems and infrastructure for affiliate data collection and automation processes, focusing on developing tools that support the affiliate team and enhance advertising capabilities.
The Senior Python Automation Engineer will design and build scraping solutions using Python and AWS services, focusing on automating data extraction from complex, secure websites in the fintech sector.
Ascendeum is seeking an experienced professional to design, develop, and implement automation solutions, focusing on data automation and web scraping, to enhance system efficiency.
Sii Group Colombia is seeking a Web Scraper Developer for an international project, responsible for designing and maintaining large-scale data extraction solutions, developing backend systems in Java and Node.js, and implementing evasion mechanisms against blocks.
Decskill is seeking an ETL Developer to design and operate ETL pipelines that import tariff and customs nomenclature data, utilizing web crawling and scraping techniques. The role involves working in a hybrid model from Porto, Portugal, with responsibilities including data quality checks and collaboration with domain experts.
The role involves automating processes and supporting a distributed scraping application using a cloud-native technology stack. Candidates will monitor application status, troubleshoot issues, and collaborate with teams to streamline workflows.
Sii Group Colombia is seeking a Backend Developer specializing in Web Scraping to design and maintain large-scale data extraction solutions, develop backend services, and implement anti-bot strategies.
WebDataGuru is looking for a Senior Data Engineer with expertise in ETL development and bulk data extraction through web scraping and crawling technologies. The role involves managing large-scale data projects and ensuring best practices in security, scalability, and performance.
The AI Enablement Lead will drive the adoption of AI technologies within the company, focusing on identifying opportunities for AI leverage, prototyping new tools, and ensuring teams have the necessary resources and knowledge. This role involves collaboration with engineering and business stakeholders to translate AI experimentation into practical applications.
Speechify is seeking a Software Engineer to join their AI team, focusing on data collection to support model training operations, including building high-quality datasets at petabyte-scale.
Hanzo is seeking a Senior Crawl Engineer to manage crawler operations, configure and develop custom crawler code, and support customers in web archiving. This role involves working with various web technologies and requires strong problem-solving skills.
The role involves designing, building, and maintaining automation workflows using n8n, integrating APIs, and developing AI-powered web applications. The engineer will work collaboratively to enhance automation processes and explore AI-agent solutions.
HEROIC Cybersecurity is looking for a senior-level Threat Intelligence Data Engineer to design and operate automated intelligence collection systems for cybersecurity and breach intelligence platforms, focusing on discovering and indexing data from various sources including the dark web.
The Lead Data Engineer at Sunday Ins Co., Ltd. will oversee the architecture and reliability of the company's data platform, leading a team to optimize data processes and ensure data governance while collaborating with various functional teams.
The Senior Web Crawling Engineer will build and maintain web crawling infrastructure to support data extraction and analytics platforms, focusing on developing scalable crawlers and optimizing their performance, at Hexanix One, a data and AI consultancy serving healthcare, retail, and manufacturing clients.
The Back-End Developer role involves developing software focused on web scraping, building automations, and internal SaaS applications to enhance client fulfillment.
Speechify is seeking a Software Engineer for their AI team to manage data collection for model training, focusing on building high-quality datasets at scale.
The role involves building and maintaining data pipelines and cloud orchestration, focusing on Python ingestion from various data sources, and developing a canonical data model using Azure and SQL technologies.
Nebius is seeking a Senior Software Engineer to develop content acquisition and crawling infrastructure for a search engine designed for AI systems. The role involves building systems for discovering and fetching content from the web, ensuring high-quality data is available for indexing and retrieval.
The Data Engineering & Automation Lead will design, automate, and optimize large-scale data processing and web scraping pipelines, leading a team to build high-performance ETL workflows and integrate AI/NLP solutions for intelligent data extraction and analytics.
Klar is seeking a Data Engineer to join their Revenue Ops team, responsible for building and maintaining web scraping services, creating data pipelines, and improving data reliability and quality.

Apify is seeking an AI Engineer to build and maintain their MCP Server, enabling autonomous agents to utilize various tools for web automation and data extraction. The role involves working with a small team to address complex problems in a rapidly evolving tech landscape.
The role involves managing and coordinating app operations within a team that develops proxy and web data scraping solutions, focusing on maintaining infrastructure and ensuring smooth communication among product, development, and marketing teams.
The role involves supporting the enhancement of the High-Resolution Map by automating the discovery and collection of geospatial information, developing workflows for web crawling and data extraction, and applying AI techniques for structured data extraction from unstructured sources.

Apify is seeking a Senior Full-stack Engineer to develop tools and features for community developers to create, publish, and monetize their web-based applications known as Actors, contributing to the AI ecosystem. The role involves end-to-end project ownership and collaboration within a cross-functional team.
This role involves maintaining and evolving an in-house patched-browser cloud, focusing on browser internals and fingerprinting to ensure automation remains undetectable. The position requires strong C++ skills and a deep understanding of browser engines.

Exa is seeking a Software Engineer for their Knowledge Systems team to develop complex distributed backend systems that extract and reason over knowledge from the web, enhancing AI agents' ability to answer questions accurately. The role involves building data pipelines and ensuring data quality while working on innovative projects related to factual information retrieval.

Exa is seeking a backend engineer to contribute to their innovative search engine project, focusing on building high-performance systems for processing and retrieving vast amounts of web data. The role involves optimizing data processing pipelines and enhancing search architecture.
The AI Engineer role at FinCatch Limited involves developing AI-powered applications, integrating large language models, and implementing web scraping solutions for data collection and processing. The position requires expertise in Python, cloud platforms, and modern web development technologies.
The job involves developing and implementing strategies to enhance the company's web scraping capabilities while ensuring compliance with legal and ethical standards. The role focuses on optimizing data extraction processes and mitigating risks associated with scraping activities.
The Senior Go Developer role at Massive involves building and scaling infrastructure for web data collection, including proxy networks and automation tools, with a focus on full-stack development using Go and integrating AI tools into data workflows.
The Support Engineer role at Massive involves assisting customers with web scraping and proxy usage, troubleshooting issues, and creating documentation to enhance user experience and satisfaction.

Exa is seeking an infrastructure engineer to build and scale massive-scale machine learning systems, focusing on GPU orchestration and automation to enhance their web crawling and AI capabilities.
Sphinx is seeking engineers to build AI agents that automate compliance processes for banks and fintechs, tackling complex technical challenges in financial crime data processing.

Exa is seeking Generalist Research Engineers to enhance their search engine by improving crawling, parsing, and machine learning performance. The role involves designing new parsers and optimizing web crawlers to improve retrieval performance.

Exa is seeking a Data Engineer to design and build data infrastructure for a large-scale AI-driven search engine, focusing on processing and retrieving vast amounts of web data. The role involves creating data pipelines and architectures that handle petabytes of information, ensuring reliability and performance.