Evaluate and track machine-learning models
Check a model's data and benchmark scores and keep its versions and lineage -- as against evaluating an agent's behaviour. 48 products across 38 companies in the Ludbee catalogue carry this task — across 3 of the 4 layers of the stack: 13 Application, 22 Infrastructure, 3 Foundation Models.
Filter the whole directory by this job to sort and compare these products.
Where these run
- SaaS
- 41 of 47 products that record it
- Self-hosted
- 14 of 47 products that record it
- Private cloud
- 9 of 47 products that record it
- Hybrid
- 6 of 47 products that record it
- Air-gapped
- 3 of 47 products that record it
- On-device
- 1 of 47 products that record it
1 of 48 products carry no recorded deployment yet, and one product can run more than one way — the counts above are of records, not of products.
What this page does not claim
This list carries no score and no recommendation, and one order only: inside each layer, a company whose product for this task is marked AI feature — sold for another job, with AI as one function its own page names — comes after the rest, A–Z within each. The standing rule that applies to the whole directory applies here too: no payment changes a figure, a ranking or the order of any list, this one included. Nor can it yet say what governs any of these products once deployed — what data they can reach, what they are certified against, whether a vendor trains on what you send it. That field is defined in the ontology and is populated on none of the 5,815 products in the catalogue yet, so a page that leaned on it would be promising an answer the data cannot back. It will say so here the day that changes.
The companies
Application (13)
- Advai — Advai Platform
- Daiki — Daiki AI Registry
- Dataiku — Dataiku
- HumanSignal — Label Studio Enterprise, Prompts
- Luminary Cloud — Luminary Platform
- Oracle — OCI Data Science
- Resaro — Approved Intelligence Platform
- SAS — SAS Model Manager
- Siemens — AI Asset Manager
- UiPath — UiPath AI Center
- ValidMind — ValidMind AI Governance, ValidMind Development Automation (AI feature), ValidMind Validation Automation (AI feature)
- VerifyWise — LLM Evaluation Platform
- Warden AI — Warden AI Platform
Infrastructure (22)
- Appen — Appen Model Integrity
- Arthur AI — Arthur Observability
- Belvedir — Belvedir
- Comet ML — Comet Artifacts, Comet Experiment Tracking, Comet Model Production Monitoring
- CoreWeave — CoreWeave ARIA, CoreWeave Model Distillation
- CUBIG — Syntitan
- Databricks — Managed MLflow
- DataRobot — DataRobot Agent Workforce Platform
- Deccan AI — Helix
- Deepchecks — Deepchecks ML Testing
- Encord — Encord, Encord Active
- Labelbox — Labelbox Foundry
- Nebius Group — Managed Service for MLflow
- Neysa — Neysa Velocis
- Ocular AI — Ocular Data Marketplace
- OpenRouter — Ori
- Panels — Panels datasets
- Prime Intellect — Model Factory
- PromptLayer — Evaluations
- QuantPi — QuantPi platform
- Scale AI — Scale Data Engine, Scale Nucleus
- Weights & Biases — CoreWeave Registry, W&B Models, W&B Skills