United Kingdom
EuropeResearch Engineer - Web Crawlers
вчера
United KingdomEuropeRemote
web crawlingmachine learningpythondata analysis
Research Engineer working on AI web crawler technologies in an AI research and product company.
Обязанности
- We are looking for a Research Engineer to join the research team at , focused on large-scale web crawling for our frontier AI models. The quality of our models is bounded by the quality and scale of the data behind them, and you will own the crawling systems that source world-class data from the open web. You will thrive in this role if you enjoy:
- Building and operating large-scale, distributed web crawlers that discover, fetch, and extract data across billions of pages reliably and efficiently.
- Solving hard crawling problems such as content extraction from messy HTML, deduplication at web scale, freshness and recrawl strategies, and politeness and rate-limit handling.
- Designing targeted crawling pipelines that find high-value data sources, including audio, video, and multilingual content, and turn them into clean training-ready datasets.
- Creating tooling and infrastructure that lets researchers request, monitor, and explore newly crawled web data quickly and reliably.
Требования
- We do not require any formal certifications or degrees. Instead, we are seeking enthusiastic engineers who can showcase solving impressively hard problems with artifacts such as past projects, designs, or GitHub contributions. Ideally, you bring:
- Hands-on experience building and scaling web crawlers or scraping systems, ideally in support of machine learning training data.
- Strong engineering skills in distributed systems at scale (e.g., Kubernetes, queue-based architectures, or custom pipelines processing billions of documents).
- The capacity to autonomously evaluate the quality, coverage, and compliance of crawled data, and to build the tooling to measure it.
Условия
- Innovative culture: You’ll be part of a generational opportunity to define the trajectory of AI, surrounded by a team pushing the boundaries of what’s possible.
- Growth paths: Joining means joining a dynamic team with countless opportunities to drive impact - beyond your immediate role and responsibilities.
- Learning & development : proactively supports professional development through an annual discretionary stipend.
- Social travel : We also provide an annual discretionary stipend to meet up with colleagues each year, however you choose.
- Annual company offsite: Each year, we bring the entire team together in a new location - past offsites have included Croatia and Italy.
- Co-working : If you’re not located near one of our main hubs, we offer a monthly co-working stipend.
Другое
- is an AI research and product company transforming how we interact with technology.
- We launched in January 2023 with the first human-like AI voice model. Today, we serve millions of users and thousands of businesses - from fast-growing startups to large enterprises like Deutsche Telekom and Meta. Our investors are some of the world's most prominent, including Andreessen Horowitz, ICONIQ Growth and Sequoia. We've raised $781M in funding and our last valuation was $11B - multiples of 11, always. We have expanded from voice into three main platforms:
- ElevenAgents enables businesses to deliver seamless and intelligent customer experiences, with the integrations, testing, monitoring, and reliability necessary to deploy voice and chat agents at scale.
- ElevenCreative empowers creators and marketers to generate and edit speech, music, image, and video across 70+ languages.
- ElevenAPI gives developers access to our leading AI audio foundational models.
- Everything we do is the result of the creativity and commitment of our team - builders doing the best work of their lives. We are researchers, engineers, and operators. IOI medalists and ex-founders. If you want to work hard and create lasting positive impact, we want to hear from you.
- High-velocity: Rapid experimentation, lean autonomous teams, and minimal bureaucracy.
- Impact not job titles: We don’t have job titles. Instead, it’s about the impact you have. No task is above or beneath you.
- AI first: We use AI to move faster with higher-quality results. We do this across the whole company—from engineering to growth to operations.
- Excellence everywhere: Everything we do should match the quality of our AI models.
- Global team: We prioritize your talent, not your location.
- This role is remote and can be executed globally. If you prefer, you can work from our offices in London, New York, San Francisco, and Warsaw.
- #LI-Remote
- We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or other legally protected statuses.