12 LLM observability platforms, compared attribute by attribute
EvalIndex is a reference index of the platforms teams use to trace, evaluate and monitor LLM applications. Every attribute below was assessed first-hand, and every value carries its own source URL and the date it was last checked. There are no user reviews. A listing, a rank and an assessment's outcome cannot be bought. What EvalIndex does sell — a clearly labelled vendor-authored block on a vendor's own record, and expedited assessment queue position — changes no rank, no value and no assessment; the Pricing page states it plainly.
12 LLM observability platforms, one row each, every value sourced and dated
Every value is sourced and dated; open a record for its evidence. Rows are ordered alphabetically by platform name. Price units differ per vendor — the price column is not a like-for-like comparison.
| Platform | Licence | Self-host | OpenTelemetry | Free tier limits | Price per 100k traces | Data residency | Retention | SDK languages | Last release |
|---|---|---|---|---|---|---|---|---|---|
| Arize AX | no software licence published (commercial) | Enterprise tier only | yes — OTLP gRPC/HTTPS, EU endpoint | 25k spans + 1 GB/mo, 15 days | not trace-denominated; no unit rate | US, EU or CA | 15d Free · 30d Pro (13mo add-on) · custom Ent | Python, TS/JS; Java via integrations | unversioned; changelog 19 Aug 2026 |
| Braintrust | no platform licence published; SDKs Apache-2.0 | Enterprise: customer runs the data plane | yes — OTLP HTTP endpoint | Starter $0: 1 GB, 10k scores, 14 days | not trace-denominated; GB + score counts | US or EU, fixed at org creation | logs 14d–365d (180d+ paid); experiments 365d | TS, Python, Go, Java, Ruby, C#; Rust alpha | data plane v2.11.0, August 2026 |
| Confident AI | no platform licence published; SDK Apache-2.0 | Enterprise only, Terraform + Helm | yes — native OTLP endpoint | 1 GB-month spans, 2 seats, 1 week | ~$1/GB-month; 100k traces ≈ 1 GB | US default; EU region; custom on Ent | Free 1 week; paid tiers unlimited | Python, TypeScript; others via OTel | changelog 21 August 2026, unversioned |
| Galileo | no platform licence published; SDK Apache-2.0 | Enterprise only (VPC or on-prem) | yes — dedicated OTLP trace endpoint | 5,000 traces/mo; retention unstated | not published above 50k traces/mo | United States (privacy policy) | unstated | Python, TypeScript, REST API | 4 August 2026 (feature entry) |
| Helicone | Apache-2.0 | yes — Docker, Helm or manual install | unstated — no OTLP ingest documented | 10,000 requests/mo, 1 GB, 7 days | unstated; priced per request | EU or US regions | 7d · 1mo · 3mo · Enterprise forever | TypeScript/Node.js, Python, Go, HTTP | changelog 26 November 2025 |
| HoneyHive | proprietary; client tooling MIT | Enterprise BYOC/BYOVPC on AWS EKS | yes — OTel TracerProvider, OTLP export | 10,000 events/mo, 5 users, 30 days | unstated; no paid unit price published | Developer: AWS US-West-2; Ent custom | 30 days free; custom on Enterprise | Python, TypeScript, CLI, OpenAPI clients | changelog 14 August 2026; CLI v1.6.0 |
| Laminar | Apache-2.0; Signals need enterprise key | yes — Docker Compose or Helm | yes — OTLP gRPC, HTTP/proto, HTTP/json | 1 GB data, 7 days, 1 project, 1 seat | not trace-denominated; per GB ingested | unstated; trust centre unreadable | 7d · 30d · 6 months · custom | TypeScript, Python; others via OTLP | v0.2.1, 9 July 2026 |
| Langfuse | MIT (core); ee/ dirs licensed separately | yes — Docker, Helm, Terraform | yes — native OTLP ingest endpoint | 50k units/mo, 30 days, 2 users | $8/100k units (a unit is not a trace) | US, EU or JP; HIPAA on Pro and above | data access: 30d · 90d · 3y by plan | Python, JS/TS; Java and Go via OTel | 4.16.0, 21 August 2026 |
| LangSmith | proprietary; no open-source core | Enterprise only: BYOC or your VPC | yes — OTLP endpoint, ingest and export | 5k base traces/mo, 1 seat, 14 days | $500 (0.005 LSU per base trace) | LangChain Cloud US or EU; VPC option | base 14 days; extended 400 days | Python, TypeScript, Go, Java | cloud changelog, 10–17 August 2026 |
| Opik | Apache-2.0 (core) | yes — full platform, minus user management | yes — HTTP transport only, no gRPC | 25k spans/mo, 60 days, 10 members | not trace-denominated; $5 per 100k spans | US (Free, Pro); custom on Enterprise | 60 days; 400-day add-on on Pro | Python, TypeScript; others via OTel | 2.2.36, 21 August 2026 |
| Portkey | no platform licence published; gateway core MIT | Enterprise hybrid: data plane in your VPC | yes — OTLP backend, W3C traceparent | 10k recorded logs/mo, 3-day log retention | not trace-denominated; $49/100k recorded logs | unstated for the hosted cloud | logs 3d/30d/custom; metrics 30d/90d | Python, Node.js/TS; C# documented | Gateway 2.18.0, 10 August 2026 |
| Pydantic Logfire | closed-source server; MIT client SDKs | Enterprise only, open-sourced Helm chart | yes — OpenTelemetry-native, OTLP ingest | 10M records/mo hard-capped at $0 | $0.20/100k records (not per trace) | EU or US; any GCP region on Dedicated | 30 days; up to 90 on Growth | Python, JS/TS, Rust; others via OTel | v4.41.0, 20 August 2026 |