kieranklaassen / leva
LLM Evaluation Framework for Rails apps to be used with production data.
Why this job: says: llm evaluation, evaluation framework; topics: llm-evaluation
What it does
Leva is a Ruby on Rails framework for evaluating Language Models (LLMs) using ActiveRecord datasets on production models. It provides a flexible structure for creating experiments, managing datasets, and implementing various evaluation logic on production data with security in mind.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 5 months ago
- Stars
- 148
- +1 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.3.4
- Released 10 months ago
- Built with
- Ruby
- 44% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 80% closed
- 1 still open
- Pull requests
- 21 merged
- 5 waiting
- Releases
- 1
- 1 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| overmind-core / overmind | 754 | today | AGPL-3.0 | No downloads |
| truera / trulens | 3,631 | 5 days ago | MIT | No downloads |
| georgeguimaraes / tribunal | 119 | 14 days ago | MIT | No downloads |
More: languages, topics and project record
Languages
- Ruby 44%
- HTML 43%
- CSS 12%
- JavaScript 1%
Topics
- llm
- llm-evaluation
- ruby-on-rails
Project record
- JobEvals and observability
- StatusListed
- Commits221
- Forks9
- Watching2
- Stars in 28 days+1
- CreatedAug 13, 2024
- First seen by usNov 7, 2026
- CheckedNov 8, 2026