kaiko-ai / eva
Evaluation framework for oncology foundation models (FMs)
Why this job: says: evaluation framework
What it does
- Standardized benchmarking for oncology foundation models
- Supports patch-level/slide-level/scan-level classification, 2D/3D semantic segmentation, and VQA tasks
- Offline + online evaluation modes
- Built-in support for popular medical datasets and models
- Robust evaluation with multi-run statistics
Get started
pip install "kaiko-eva[all] @ git+https://github.com/kaiko-ai/eva.git" - Maintenance
- Active
- Last commit 3 months ago
- Stars
- 175
- On GitHub
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- 0.4.5
- Released 6 months ago
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 97% closed
- 11 still open
- Pull requests
- 525 merged
- 21 waiting
- Releases
- 16
- 3 in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| EuroEval / EuroEval | 204 | 3 days ago | MIT | No downloads |
More: languages, topics and project record
Languages
- Python 100%
Topics
- oncology
- machine-learning
- evaluation-framework
- foundation-models
- radiology
- pathology
Project record
- JobEvals and observability
- StatusListed
- Commits470
- Forks42
- Watching5
- Stars in 28 days+3
- CreatedJan 16, 2024
- First seen by usNov 7, 2026
- CheckedNov 8, 2026