The role involves working as a Python Developer within the scraping team, focusing on optimizing data collection through the design and implementation of robust Scrapy spiders, conducting code reviews, and developing sophisticated web crawling solutions.
Open roles 6 listed
This role involves contributing to the development and maintenance of a fleet of web crawlers for automated large-scale data collection, as well as participating in the migration of the existing ecosystem to a new Python-based platform using Scrapy.
The role involves reverse engineering and decompilation of web and mobile applications to enhance data extraction methods and overcome anti-bot mechanisms. The candidate will develop custom tools and implement stealthy scraping techniques to maintain operational discretion.
The role involves designing and building distributed scraping architectures, reverse engineering APIs and mobile apps, and leading technical innovation in scraping while collaborating with various teams to ensure high-quality data extraction.
As a Senior Python Developer on the scraping team, you will design and implement robust Scrapy spiders to optimize data collection, conduct code reviews, and develop sophisticated web crawling solutions to bypass anti-bot measures.
The role involves reverse engineering and decompilation of web and mobile applications, overcoming anti-bot mechanisms, developing custom tools, and implementing stealthy scraping techniques to enhance data extraction methods.