Rhesis
Rhesis lets experts write test cases and review results in a web UI while engineers pull the annotated test sets into CI through a Python SDK, REST API or MCP to evaluate LLM applications and agents.
What it does
- Evaluation and observability
Features 5
- Expert case test fan-outA single reviewed case is expanded into concrete tests.
- Agent API connectionConnects the agent you already run through its API.
- Rule-based metricsMetrics judge every reply against your rules, step by step.
- Scheduled test runsTest sets run against the agent on every change or every night.
- CI access via SDK or MCPTest sets and results can be pulled into CI through the SDK or MCP.
Sources
- Pricing
-
Pricing page: "Team is 299 EUR a month plus VAT, billed by invoice; there is no card checkout yet."
- Description
-
Official documentation · 11 Nov 2026
Product page: "Pull them with the Python SDK, the REST API, or MCP, then run them as a pipeline gate."
- What it does
-
Official documentation · 11 Nov 2026
Product page: "Pull them with the Python SDK, the REST API, or MCP, then run them as a pipeline gate."
- Sold within
-
Sold on its own with published plans.
- Name
-
Official documentation · 11 Nov 2026
Name as published on the product page.
- URL
-
Official documentation · 11 Nov 2026
Product page, read 2026-11-11.
- Deployment
-
Official documentation · 11 Nov 2026
Product page: "Self-hosted it runs on your infrastructure with nothing metered; on Rhesis Cloud it runs on ours and your plan carries a monthly allowance."
- Interfaces
-
Official documentation · 11 Nov 2026
Product page: "Self-hosted it runs on your infrastructure with nothing metered; on Rhesis Cloud it runs on ours and your plan carries a monthly allowance."
Open Rhesis AI in the directory
Something wrong here? Send a correction — quote this product id: rhesis-ai-rhesis.