Test and evaluate an AI agent
Check a support or task agent's behaviour before and during rollout -- simulated conversations, A/B tests of its logic and tone, and scored evaluations. 44 products across 36 companies in the Ludbee catalogue carry this task — spanning every layer of the stack that exists here, not one of its own: 18 Application, 16 Infrastructure, 1 Foundation Models, 1 Hardware.
Filter the whole directory by this job to sort and compare these products.
Where these run
- SaaS
- 40 of 44 products that record it
- Self-hosted
- 12 of 44 products that record it
- Private cloud
- 3 of 44 products that record it
- Hybrid
- 1 of 44 products that record it
One product can run more than one way — the counts above are of records, not of products.
What this page does not claim
This list carries no score and no recommendation, and one order only: inside each layer, a company whose product for this task is marked AI feature — sold for another job, with AI as one function its own page names — comes after the rest, A–Z within each. The standing rule that applies to the whole directory applies here too: no payment changes a figure, a ranking or the order of any list, this one included. Nor can it yet say what governs any of these products once deployed — what data they can reach, what they are certified against, whether a vendor trains on what you send it. That field is defined in the ontology and is populated on none of the 3,888 products in the catalogue yet, so a page that leaned on it would be promising an answer the data cannot back. It will say so here the day that changes.
The companies
Application (18)
- Clay — Claygent Builder
- Crescendo — Optimization Agent
- Decagon — Experiments, Testing & QA
- eGain — eGain Smart Evaluator
- Harness — AI Evals
- Hippocratic AI — AI Call Supervisor, AI Certified Agent Builder
- Kore.ai — Arch AI
- LivePerson — LivePerson Syntrix
- Micro1 — Cortex
- Microsoft — AI Red Teaming Agent, Foundry Control Plane
- Palantir — AIP Evals
- Palo Alto Networks — Prisma AIRS AI Red Teaming
- Parloa — Parloa Performance Lab
- PolyAI — Wren
- Relevance AI — Invent
- Retell AI — Retell AI Conductor
- Runway — Runway Offline Policy Evaluation
- Synthflow — Aurora
Infrastructure (16)
- Arize AI — Signal
- Arthur AI — Arthur Agent Development Toolkit
- Comet ML — Ollie
- CoreWeave — CoreWeave Agent Lens, CoreWeave Forge
- HoneyHive — HoneyHive
- Hume AI — User Testing API
- Laminar — Laminar (AI feature), Laminar Signals
- LangChain — LangSmith Chat, LangSmith Evaluation (AI feature)
- LangWatch — LangWatch Instant Evals, Langy
- LiteLLM — LiteLLM Lens
- Lunary — Lunary
- Mastra — Mastra Studio
- Maxim AI — Maxim
- OpenRouter — Ori Eval
- PromptLayer — PromptLayer Observability
- Respan — Respan, Respan AI Gateway