GPU Monitoring
Datadog's Infrastructure-family product for shared GPU fleets across cloud, on-prem and neocloud providers: it links device health, cost and performance to the workloads and teams using them, alerts on unmet GPU requests, thermal throttling and ECC/XID errors, forecasts GPU demand and recommends optimisations such as reclaiming GPUs held by zombie processes. The page markets alerting, forecasting and recommendations but does not name a model or AI mechanism behind them.
Find alternatives to GPU Monitoring
What it does
- Evaluation and observability
- Data analysis
Features 5
- Unified GPU fleet viewShows fleet size and spend across hyperscalers, on-prem and neocloud providers in one view.
- GPU usage by project or tagTracks organizational GPU usage broken down by project, service or any tag.
- GPU demand forecastingForecasts GPU demand to avoid long procurement cycles and make spending more predictable.
- Hardware health correlationConnects hardware health such as heat, power and hardware errors with workload context.
- Unmet GPU request alertsAlerts on workloads or clusters with unmet GPU requests to detect resource contention.
Sources
- Description
-
Official documentation · 5 Sep 2026
Fetched. Title 'GPU Monitoring for AI Workloads | Datadog'; 'Datadog GPU Monitoring delivers end-to-end visibility across shared GPU fleets by linking device health, cost, and performance directly to the workloads and teams using them ... whether deployed in cloud, on-prem, or neocloud environments'; 'With proactive alerting and actionable recommendations, GPU Monitoring helps teams optimize efficiency, resolve stalled or failed AI workloads, prevent hardware issues, and reduce wasted spend.'; 'Forecast GPU demand'; 'guided optimization actions like reclaiming GPUs tied up by zombie processes'; 'alerts on workloads or clusters with unmet GPU requests'; 'Detect and remediate ECC/XID errors proactively with built-in alerts and prescriptive next steps'; 'just by toggling a single configuration flag in the Datadog Agent'. Docs H1 'GPU Monitoring': 'provides a centralized view into your GPU fleet's health, cost, and performance.' No sentence on either page names an AI/ML mechanism.
- Security
-
Platform-wide: Datadog Trust Hub platform-security page and docs data-security page describe org-level controls (SAML, MFA, RBAC, Audit Trail) that apply to the whole Datadog platform; covers all listed products only as platform features, not per-product. Certifications, training, ZDR, residency not stated on curl-readable pages (trust.datadoghq.com returns 403 to curl); Bits AI marketing page mentions zero retention only at third-party AI providers, so ZDR left unknown.
- Sold within
-
Official documentation · 5 Sep 2026
The site's Product menu files 'GPU Monitoring' under the 'Infrastructure' group beside Infrastructure Monitoring, Metrics, Network Monitoring, Container Monitoring, Kubernetes Autoscaling, Serverless, Cloud Cost Management, Cloudcraft and Storage Management; the page's 'Works great with' box names Agent Observability and Infrastructure Monitoring, and data is collected 'by toggling a single configuration flag in the Datadog Agent'. No page states a plan that includes it.
- Intended for
-
"Platform and ML teams get a unified view across their entire fleet—whether deployed in cloud, on-prem, or neocloud"
Also from Datadog
-
Agent Observability Developer tool
Traces, evaluates and monitors LLM and AI-agent applications in production, with offline experimentation on datasets built from real traces.
-
Bits Chat Application
Conversational AI interface for querying Datadog metrics, logs, traces and monitors in natural language and generating dashboards and notebooks, accessible from Datadog, Slack or mobile.
-
Bits Investigation AI agent
AI SRE agent that autonomously investigates every alert the moment it fires, explores multiple root-cause hypotheses in parallel and reports findings into Slack, Jira, ServiceNow or GitHub.
-
Bits Code AI agent
Coding agent that triages production errors, regressions and vulnerabilities from Datadog telemetry, generates fixes with unit tests grounded in logs, traces and runtime variables, and opens pull requests for review.
-
Bits Agent Builder Agent platform
No-code builder for custom AI agents that investigate, decide and act inside Datadog to automate incident response, observability, security and operational workflows.
-
Bits Security Analyst AI agent
Always-on AI SOC analyst that autonomously triages and investigates security alerts and delivers written investigation results to Datadog, Slack or Jira within minutes.
-
Datadog MCP Server Developer tool
Model Context Protocol server that gives AI coding agents such as Claude Code, Cursor and Codex secure real-time access to Datadog logs, metrics and traces under existing RBAC controls.
-
AI Impact Application
Detects AI-assisted pull requests from coding assistants such as Claude Code, Cursor and GitHub Copilot and compares them on adoption, PR throughput, cycle time, change failure rate and daily cost per active user.
-
Watchdog Application
Datadog's built-in AI engine: it continuously analyses metrics, traces and logs across the platform to raise anomaly alerts without configuration, detect faulty deployments by comparing code versions, run automated root-cause analysis on critical failures and surface tag-based insights and impact analysis. Available inside Infrastructure Monitoring, APM, Log Management and RUM rather than sold on its own.
-
Bits Release AI agent
Bits Release is an AI agent that validates code changes from pull request to production; also investigates likely root causes and proposes fixes.
-
Bits Testing AI agent
Bits Testing uses AI to discover application workflows and generate synthetic tests.
-
Bits Threat Hunting AI agent
Preview AI agent in Datadog Cloud SIEM that turns threat intelligence into complete investigations: it generates hypotheses, analyses activity across the environment and returns validated findings with recommended actions, including automated detection rules.
-
Bits Data Analysis AI agent
Preview AI teammate for ad-hoc data questions across Datadog and warehouse data: answers natural-language questions with SQL-backed answers, charts and dashboards.
-
AI Gateway API service
Single endpoint that governs an organisation's LLM use: routes agent and application traffic to OpenAI, Anthropic, Amazon Bedrock, Google Vertex AI or Azure OpenAI, with spend budgets, team-level model access, policy enforcement and fallback when a model is over budget, rate-limited or down.
-
AI Agents Console Application
Console for monitoring the performance, reliability, adoption, errors and cost of AI coding tools and enterprise AI agents across an organisation, with early access for Claude Code, Cursor and MCP servers.
-
Datadog AI Guard API service
Inline security layer for agentic AI applications: evaluates prompts, model responses and tool calls in real time and blocks prompt injection, jailbreaking and sensitive-data exfiltration before they reach critical systems.
Something wrong here? Send a correction — quote this product id: datadog-gpu-monitoring.