TensorZero by tensorzero
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
About TensorZero
From the project's README at github.com/tensorzero/tensorzero. Lightly cleaned for readability; for the full source see the upstream repo.
TensorZero is an open-source LLMOps platform that unifies: Gateway: access every LLM provider through a unified API, built for performance (<1ms p99 latency) Observability: store inferences and feedback in your database, available programmatically or in the UI Evaluation: benchmark individual inferences or end-to-end workflows using heuristics, LLM judges, etc. Optimization: collect metrics and human feedback to optimize prompts, models, and inference strategies Experimentation: ship with confidence with built-in A/B testing, routing, fallbacks, retries, etc.
You can take what you need, adopt incrementally, and complement with other tools. It plays nicely with the OpenAI SDK, OpenTelemetry, and every major LLM provider.
TensorZero is used by companies ranging from frontier AI startups to the Fortune 10 and fuels ~1% of global LLM API spend today.
Health score breakdown
6-dimension composite. See methodology for formula and weights.
Adoption signals
Real-world usage data, pulled from each registry. The bigger the numbers, the more battle-tested the project.
| Signal | Value | Source |
|---|---|---|
| GitHub stars | 11k | github.com/tensorzero/tensorzero |
| GitHub forks | 822 | github.com/tensorzero/tensorzero |
| CRATES downloads (last month) | 6 | tensorzero |
Release & maintenance
Is this project actively maintained, or about to die? Check the recency of last commit and last release.
| Project age | 1.8 years | since Jul 2024 |
| Last commit | 2 days ago | May 5, 2026 |
| Releases shipped | 117 | last: 13 days ago |
| Security policy | SECURITY.md | declared by maintainers |
Self-hosting cost across providers
Detected requirements: 4GB RAM, 40GB disk minimum. Cheapest plan per provider that meets the requirement.
| Provider | Plan | Specs | Monthly | |
|---|---|---|---|---|
| hetzner | CAX11 | 2c · 4GB · 40GB | $4.13 USD | Deploy → |
| vultr | VC2 | 1c · 1GB · 25GB | $5 USD | Deploy → |
| linode | Nanode 1GB | 1c · 1GB · 25GB | $5.12 USD | Deploy → |
| digitalocean | Basic Regular 1GB | 1c · 1GB · 25GB | $6 USD | Deploy → |
What people say on Hacker News
Ready to self-host TensorZero?
Spin up a hetzner CAX11 (4GB RAM, 40GB disk) for $4.13/mo and follow the project's official install docs.
Data last refreshed May 7, 2026.
Similar open-source projects
Projects in our directory that replace the same SaaS or share topics with TensorZero.