alibaba / skill-up

What it does

• Eval-to-Evolution Loop with skill-upper. Create evals through natural conversation, diagnose failures, automatically repair or expand cases, and rerun skill-up until the eval suite evolves.
• Declarative Eval Config. Define evaluation environment, engine, model, and cases through YAML (eval.yaml + cases/*.yaml).
• Environment Provisioning. Prepare a local, Docker, or OpenSandbox runtime for each case, install configured real or mocked MCP servers into supported Agent Engines, and upload context.repo_fixture and context.files into the workspace.
• Skill-Optional Runs and Workspace Cases. Evaluate an agent without a Skill, prepare repository fixtures per case, or run against an existing local workspace with --workspace.
• Multi-Engine Support. Works with Qoder CLI, Claude Code, and Codex as built-in Agent Engines, plus user-defined agents via engine.custom (local commands or HTTP services — see docs/design/custom-engine.md).