Data Crawler Specialist

Who are we? Delectatech is a startup born in Barcelona that monitors and analyzes millions of data from any type of establishment in the Food Service channel (bars, restaurants, cafes, etc.) worldwide. After years of research, we have created our own AI engine, internationally recognized, that allows for unprecedented detail in analyzing any Food Service establishment. We offer this technology to our clients through Food Radar, the SaaS that enables leaders in HORECA manufacturing and distribution worldwide to analyze their real market in seconds, segment with maximum precision, and prioritize establishments with the most sales potential. The company has been awarded multiple times for its innovation and recognized for its contribution to applying AI in the Food Service sector. Additionally, thanks to its recent advances in Generative Artificial Intelligence, the company has been included in Microsoft's global acceleration program.

What are we looking for? We are looking for a Data Crawler Specialist to strengthen the ProdTech team and take charge of our production crawling system: how it is designed, executed, and how incidents and future improvements are resolved.

This is not about rebuilding the system from scratch, but about operating it in production, resolving daily incidents, and growing it: new sources, new countries, etc.

We are primarily looking for someone with a data engineer mindset: who enjoys solving complex crawling problems from multiple data sources capturing high volumes of data over 500GB/month (not basic scraping on open websites). We especially value autonomy and technical persistence to advance without relying on others when something gets stuck.

What is our tech stack?

• Crawling in Python from complex sites on a recurring basis, managing over 700GB monthly.
• Dynamic rendering with Playwright and Selenium for sites that require JS execution.
• Reverse engineering of APIs from mobile applications.
• Organization and storage of captured data in MongoDB.
• Infrastructure in Docker, to deploy and maintain our own crawling services.

Your mission will be to maintain and grow our production crawling system, incorporating new sources and sites, resolving incidents autonomously, and becoming an important part of the technical team.

What we are looking for in you

• Real experience (3+ years) operating crawling or scraping systems in production.
• Experience with high-volume data systems knowing methodologies such as rate limiting, proxy or user-agent rotation, CAPTCHAs, or anti-bot (Cloudflare, PerimeterX, DataDome...).
• Ability to parse complex HTML and work with JS-rendered sites (Playwright/Selenium in production).
• Experience with Python and MongoDB in professional environments.
• Demonstrable autonomy: ability to resolve a broken crawler without relying on anyone else.
• B2 level English valued, not essential.
• Positive value for experience in reverse engineering mobile applications (traffic interception with Charles Proxy, Burp Suite…).
• Remote work possibility valued at 100%.

What can Delectatech offer you? A real growth path to become an important person in the technical team, with room to make architectural decisions and grow technically.

• Fixed salary of €30,000 to €35,000 gross per year.
• Permanent contract for full-time work.
• Flexible hours, with the possibility to choose your vacation days at any time of the year.
• Work in a very innovative startup, awarded multiple times, with a real focus (not a trend) on artificial intelligence.
• A young, dynamic environment with a great atmosphere, focused on getting things into production.
• Office in Barcelona with coffee, fruit, snacks, and everything typical to make day-to-day life easier.

Seniority level

Intermediate

Employment type

Full-time

Job function

Information technology

Industries

Services and information technology