NovaEval
Scoring library of 112 published scorers across 15 categories, including model-backed judges and 36 voice scorers, applied to dataset items from instrumented AI agents.
What it does
- Evaluation and observability
Sources
- Pricing
-
Pricing page: "Free plan with 2,500 credits/month" and "One unified credit system powers everything: eval scoring, NovaSynth voice and text testing, and NovaPilot analysis."; "Scorers labeled Free cost 0 credits."
- Description
-
Official documentation · 16 Nov 2026
Page: "NovaEval applies selected compatible scorers to configured dataset items." and "112 published scorers across 15 categories".
- What it does
-
Official documentation · 16 Nov 2026
Page: "Choose compatible checks for hallucination, RAG quality, answer correctness, tool use, coherence, and safety."
- Sold within
-
Pricing page: "All plans are per organization (org-flat billing), not per seat." and eval scoring is metered in the same credit system as the platform.
- Name
-
Official documentation · 16 Nov 2026
Page title "NovaEval - 112 Published Scorers for AI Agents | Noveum.ai".
- URL
-
Official documentation · 16 Nov 2026
Product page read 2026-11-16 (server-rendered); one of the five products listed on the pricing page.
- Deployment
-
Official documentation · 16 Nov 2026
Hosted: runs inside the Noveum web app ("noveum.ai/app - NovaEval runs").
Also from Noveum.ai
-
noveum-trace Developer tool
noveum-trace records instrumented AI application executions as connected spans for inspecting model calls, tools, retrievals, agent steps, and execution metadata.
-
NovaSynth Developer tool
Tests voice and text agents with synthetic users that carry personas, interruptions and adversarial intent over real SIP phone calls, LiveKit audio and chat.
-
NovaPilot Developer tool
Analyses a dataset of evaluated agent runs, groups recurring failure patterns, flags possible system-prompt issues and ranks evidence-linked recommendations by priority, confidence and effort.
-
NovaGuard Developer tool
Sets organisation- and project-scoped caps on model spend plus request and token rate limits that a connected application or gateway enforces; in beta for design partners.
Open Noveum.ai in the directory
Something wrong here? Send a correction — quote this product id: noveum-ai-novaeval.