Toloka
Human-in-the-loop data company for frontier models: agent trajectory demonstrations and step-by-step tool-use evaluations, RL environments, safety red-teaming and domain data for coding assistants. Nebius keeps a majority economic stake but gave up voting control in 2025.
Products
Selected offerings — the AI products recorded here, not the vendor's full catalogue.
-
A self-serve platform where an AI agent turns a described data goal into a full human-annotation pipeline - RLHF and preference data, data collection, instruction tuning, model evaluation, synthetic-data validation and content-moderation QA - with LLM-based quality checks on the output.
-
Toloka Arena Platform
An independent evaluation platform that ranks frontier LLMs on agentic tool-use tasks using private, non-contaminated benchmarks across industry domains, scored on a pass^5 reliability metric, with the underlying RL Gyms and evaluation datasets available to license.
-
A hybrid AI-plus-human agent that takes a delegated task - research, data analysis, copywriting, design or development - has AI do the first pass, then routes it to one of 10,000+ vetted experts for verification and multi-layer QA, returning results in 2-24 hours.
-
Off-the-shelf Datasets Data service
Toloka's catalogue of ready-made training datasets sold outright — three named at the time of writing (Tau-bench Dataset Extension, University-level Math Reasoning, Multimodal Conversations) — as distinct from the custom data work its Platform sells.
-
Toloka Physical AI Data service
Human-in-the-loop data programs -- demonstrations, annotation and evaluation -- for training robotics and physical AI systems.
Inside Toloka Platform
-
A self-serve service that lowers per-request inference cost through two tools - fine-tuning LoRA adapters on frozen Qwen3 base models to replace a frontier API on a narrow task, and prompt gisting that compresses long instruction prefixes into learned tokens.
Closest alternatives 1
Similar products 125
Closest alternatives are pairs a vendor page itself compares. Similar products are matched from what each product does; nothing in that group is asserted as a rivalry.
Sources
- Total funding
-
Wikipedia records a single $72M round led by Bezos Expeditions in May 2025 and no cumulative total. One round is not a total, and recording it as one would understate a company that has raised before — same call as Otter.ai's.
- Valuation
-
Checked — none published
No valuation published; the parent Nebius Group is listed but does not break Toloka out.
- Employees
-
No headcount published.
- Founded
-
Infobox: founded 2014 by Olga Megorskaya; location Amsterdam, Netherlands; owner Nebius Group.
- Revenue
-
Checked — none published
Not broken out by Nebius Group.
- Description
-
Nebius, 7 May 2025: "Nebius will relinquish majority voting control of Toloka, with the aim of giving Toloka greater independence", while retaining "a significant majority economic stake". Calling it a unit of Nebius Group told half of that.
Something wrong here? Send a correction — quote this company id: toloka.