Confident AI

Confident AI is a proprietary hosted evaluation and observability platform billed at $1 per GB-month of trace spans, with unlimited retention above the free tier and Enterprise-only self-hosting.

Last verified

Assessed attributes for Confident AI, each with the source it came from and the date it was checked
Licence Cloud platform is proprietary (SaaS; self-hosted images require a CONFIDENT_LICENSE_KEY). Its open-source SDK/eval framework DeepEval is Apache-2.0. Source, checked
Self-host partial: Enterprise plan only — the full platform runs in the customer's own AWS/GCP/Azure account via a Terraform module plus the confident-ai Helm chart, using vendor-supplied private images and a licence key Source, checked
OpenTelemetry yes — natively accepts OpenTelemetry traces at an OTLP endpoint (https://otel.confident-ai.com); self-hosted deployments run a confident-otel trace ingestion collector Source, checked
Free tier limits Free forever $0: 2 user seats, 1 project, 5 test runs per week (additional locked), 1 GB-month of trace spans (additional spans dropped); retention on Free is 1 week for test-run and tracing data Source, checked
Price per 100k traces ~$1/month (USD) at the published overage rate: vendor states "~100K traces ≈ 1 GB" and charges "$1 per GB-month ingested or retained", so 100k traces = 1 GB-month = 1 × $1 = $1. Plan-denominated instead: Starter $200/mo includes 5 GB-months ≈ 500k traces → 200/500k × 100k = $40 per 100k traces of the included allowance; Team $2,000/mo includes 75 GB-months ≈ 7.5M traces → 2000/7.5M × 100k ≈ $26.67 Source, checked
Data residency US by default; an EU data region is available (https://eu.api.confident-ai.com); Enterprise adds "Custom data residency (Canada, Australia, Japan, etc.)" per the pricing page Source, checked
Retention Test-run and tracing data: Free 1 week; Starter, Team and Enterprise unlimited. Datasets and prompts are preserved while the account is active. Source, checked
SDK languages Python and TypeScript first-party SDKs (deepeval via pip and npm); any other language via the native OpenTelemetry endpoint Source, checked
Last release Cloud product changelog entry dated August 21, 2026 — "Test Runs: Brand New Page" (the hosted platform ships weekly and is not version-numbered publicly) Source, checked

Assessment

The cloud platform is proprietary; self-hosted images require a vendor licence key. Its open-source evaluation SDK, DeepEval, is Apache-2.0, and the first-party Python and TypeScript clients ship as that package. Any other language reaches the platform through its native OpenTelemetry endpoint; self-hosted deployments run a confident-otel ingestion collector.

Self-hosting is Enterprise-only: the full platform runs in the customer's own AWS, GCP or Azure account from a Terraform module and Helm chart, using vendor-supplied private images.

The free tier is 2 user seats, 1 project, 5 test runs a week and 1 GB-month of trace spans, with additional spans dropped and one week of retention; paid tiers carry unlimited retention.

Billing is per GB-month of trace spans, ingested or retained, so traces held for several months cost several times as much. On the vendor's footnote that roughly 100k traces is about 1 GB, and its $1 per GB-month rate, 100k traces costs about $1 a month at the margin. Against plan allowances, Starter at $200 a month with 5 GB-months works out near $40 per 100k traces, Team at $2,000 with 75 GB-months near $27.

Data lives in the US by default, with an EU region available and custom residency on Enterprise. The platform is not version-numbered; its newest changelog entry is dated 21 August 2026.

Something wrong on this page? Suggest a correction — corrections are free and open to everyone.