traceloop / hub
High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
Why this job: says: observability; topics: observability, llmops
What it does
- Multi-Provider Support. OpenAI, Anthropic, Azure OpenAI, Google VertexAI, AWS Bedrock
- OpenAI Compatible API. Drop-in replacement for OpenAI API calls
- Built-in Observability. OpenTelemetry tracing and Prometheus metrics
- High Performance. Written in Rust with async/await support
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 3 months ago
- Stars
- 233
- On GitHub
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- 0.10.1
- Released 3 months ago
- Built with
- Rust
- 96% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 57% closed
- 3 still open
- Pull requests
- 80 merged
- 9 waiting
- Releases
- 27
- 10 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| Netflix / metaflow | 10,341 | 3 days ago | Apache-2.0 | No downloads |
| superloglabs / superlog | 1,479 | 6 days ago | Apache-2.0 | No downloads |
| evidentlyai / evidently | 8,050 | 2 months ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Rust 96%
- Shell 4%
- PLpgSQL <1%
- Go Template <1%
Topics
- artificial-intelligence
- datascience
- generative-ai
- llm
- llmops
- ml
- model-monitoring
- observability
- open-source
- opentelemetry
- rust
Project record
- JobEvals and observability
- StatusListed
- Commits116
- Forks33
- Watching2
- Stars in 28 days+2
- CreatedOct 24, 2024
- First seen by usNov 7, 2026
- CheckedNov 8, 2026