illuin-tech / vidore-benchmark
Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
Why this job: says: benchmark
What it does
- Vision Retriever Evaluation. See README_OLD.md
- ViDoRe Benchmarks v1/v2. Now maintained in MTEB
- Model Implementations. Available in src/vidore_benchmark/retrievers/ (for reference only)
- Using MTEB for vision retriever evaluation on ViDoRe v1/v2
- Using this framework for pipeline evaluation on ViDoRe v3
Get started
pip install vidore-benchmark- Maintenance
- Active
- Last commit 20 days ago
- Stars
- 278
- On GitHub
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v5.0.0
- Released 20 months ago
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- 1
- Last 90 days
- Issues
- 75% closed
- 7 still open
- Pull requests
- 102 merged
- 1 waiting
- Releases
- 17
- 0 in the last year
- No contributing guide
- No security policy
- No code of conduct
More: languages, topics and project record
Languages
- Python 100%
- Shell <1%
Topics
- colpali
- rag
- retrieval
- search
- vision-language-model
Project record
- JobEvals and observability
- StatusListed
- Commits313
- Forks42
- Watching5
- Stars in 28 days0
- CreatedJun 18, 2024
- First seen by usNov 7, 2026
- CheckedNov 7, 2026