METR / hawk
Run Inspect AI evals in the cloud
Why this job: says: evals; topics: evals
What it does
Inspect-Hawk is a platform for running Inspect AI evaluations on cloud infrastructure. You define tasks, agents, and models in a YAML config, and Hawk handles everything else: provisioning isolated Kubernetes pods, managing LLM API credentials, streaming logs, storing results in a PostgreSQL warehouse, and serving a web UI to browse them.
Get started
uv tool install "hawk[cli]"- Maintenance
- Active
- Last commit today
- Stars
- 105
- +3 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v4.0.0
- Released 6 days ago
- Built with
- Python
- 92% of the code
Is it looked after?
- Contributors
- 19
- Last 90 days
- Issues
- 56% closed
- 182 still open
- Pull requests
- 1,691 merged
- 225 waiting
- Releases
- 31
- 30+ in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| GitHamza0206 / simba | 1,547 | 4 months ago | Apache-2.0 | No downloads |
| overmind-core / overmind | 754 | today | AGPL-3.0 | No downloads |
| hud-evals / hud-python | 324 | 3 days ago | MIT | No downloads |
More: languages, topics and project record
Languages
- Python 92%
- TypeScript 6%
- Shell 1%
- Dockerfile <1%
Topics
- aws
- evals
- inspect-ai
- llm
Project record
- JobEvals and observability
- StatusListed
- Commits2,845
- Forks64
- Watching0
- Stars in 28 days+15
- CreatedMar 23, 2026
- First seen by usNov 7, 2026
- CheckedNov 9, 2026