Ollie
AI debugging assistant built into Opik: investigates any logged trace, finds the root cause, reads your source files through opik connect, proposes code fixes for your approval, reruns your agent and adds the failing trace to a test suite to confirm the fix.
What it does
- Evaluation and observability
- Agentic coding
Sources
- Pricing
-
Pricing page read: no separate rate for Ollie; the Free Cloud card lists "Ollie coding harness trial" and the Pro Cloud card starts "Includes everything in the Free plan plus".
- Description
-
Official documentation · 18 Oct 2026
"Ask a question about any trace, let Ollie read your code, have it edit the file, rerun your agent, and verify the fix with a test suite — all without leaving the browser."; "Ollie can add a failing trace to a test suite, then trigger the suite against your updated agent".
- What it does
-
Official documentation · 18 Oct 2026
"Ollie reads full span trees, identifies root causes, and compares failing runs to successful ones."; "Ollie proposes a change. You see the diff, approve it, and the file is updated on your machine."
- Sold within
-
Free Cloud card: "Includes: Agent tracing & analysis, Test Suites & assertions, Agent Playground, Ollie coding harness trial"; the Pro Cloud card is "everything in the Free plan plus".
- Name
-
Official documentation · 18 Oct 2026
"Ollie is a conversational AI assistant built into Opik."; the Opik product page calls it the Ollie coding harness.
- URL
-
Official documentation · 18 Oct 2026
The assistant's own documentation page, "Ollie", in the Opik docs; the Opik product page links to it as Ollie, your AI debugging assistant.
- Deployment
-
The Free Cloud plan, a hosted Opik plan, lists "Ollie coding harness trial" under Includes, so Ollie is offered in the hosted product.
- Interfaces
-
Official documentation · 18 Oct 2026
"Open Ollie from anywhere in the Opik UI and start asking."; "Run opik connect in your agent folder ... opik connect --project <project-name>".
Also from Comet ML
-
Opik Platform
Open-source and hosted platform for tracing, evaluating and debugging LLM applications and agents: agent tracing and analysis, Test Suites with plain-text assertions, an Agent Playground, 30+ LLM-as-a-judge metrics, production monitoring with guardrails, and the Ollie AI debugging assistant.
-
Comet Experiment Tracking Developer tool
Comet's experiment-tracking product for logging, comparing, visualizing and reproducing machine-learning training runs.
-
Comet Artifacts Developer tool
Comet's dataset- and model-versioning product for tracking artifacts and lineage from training through production.
-
Comet Model Production Monitoring Platform
Comet's production-monitoring product for tracking deployed-model performance and data drift across the ML lifecycle.
-
Agent Optimizer Developer tool
Opik feature (also available as an open-source SDK) that automatically iterates and tunes system prompts across seven optimization algorithms before freezing them for production.
-
Cost Intelligence Application
Opik feature that tracks and attributes AI/coding-agent token spend (Claude Code, Codex) across engineering teams, surfacing recoverable-spend opportunities.
Open Comet ML in the directory
Something wrong here? Send a correction — quote this product id: comet-opik-ollie.