FA

Fiddler Auditor

Developer tool

by Fiddler AI

Source-available library for red-teaming and robustness testing of LLMs, run independently of the hosted Fiddler platform. Fiddler's own page calls it "open-source"; its repository's actual licence is the Elastic License 2.0, which is not an OSI-approved open-source licence (it restricts offering the software as a competing hosted service), so it is recorded here by its real terms rather than the vendor's label.

Find alternatives to Fiddler Auditor

No charge to obtain or run. `pricing-models.json`'s `open-source` term requires "an open licence"; the repository's actual LICENSE file is the Elastic License 2.0 (source-available, not OSI-approved open source), so that term is not applied here -- Fiddler's own page calls it "the open-source robustness library," which this record does not repeat uncorrected. Last pushed 2024-03-11 (2+ years stale) though still linked live from fiddler.ai/auditor today.

What it does

• Evaluation and observability

Sources

Pricing

Official documentation · 13 Sep 2026

LICENSE file's first line reads "Elastic License 2.0".

Description

Official documentation · 13 Sep 2026

Fiddler's own page: "Fiddler Auditor is the open-source robustness library for red-teaming of LLMs." Contradicted by the repository's own LICENSE file (Elastic License 2.0, fetched via the GitHub API and raw.githubusercontent.com the same day) -- recorded here as source-available, not open-source.

Sold within

Official documentation · 15 Sep 2026

GitHub repo (already cited official-docs elsewhere on this record); obtained directly, independent of the hosted Fiddler platform.

URL

Official documentation · 13 Sep 2026

Repository home.

Deployment

Official documentation · 13 Sep 2026

"Get access to Fiddler Auditor in Github" -- run locally, not a hosted service.

Also from Fiddler AI

• Fiddler AI Platform

  AI observability platform: evaluation, monitoring and real-time guardrails for ML models and generative AI/agentic applications in production.

• Fiddler Agentic Observability Application

  Tracing and monitoring module for multi-step agent workflows within the Fiddler AI Control Plane, tracking tool calls, reasoning steps and failures across an agent's execution.

• Fiddler AI Governance, Risk Management, and Compliance Application

  Governance module within the Fiddler AI Control Plane providing model inventories, policy enforcement and audit-ready reporting for regulatory compliance (e.g. EU AI Act) across an organization's AI systems.

• Fiddler Continuous Evaluations Application

  Ongoing automated evaluation module within the Fiddler AI Control Plane that re-scores production LLM/agent outputs against quality and safety metrics over time, not just at launch.

• Fiddler Guardrails Application

  Runtime safety layer within the Fiddler AI Control Plane that screens LLM/agent inputs and outputs for hallucination, toxicity, PII and jailbreak attempts before they reach users.

Open Fiddler AI in the directory

Something wrong here? Send a correction — quote this product id: fiddler-auditor.