copilot-swe-agent[bot]
20 lines
643 B
Markdown
20 lines
643 B
Markdown
# Benchmark Template
|
|
|
|
This directory provides scaffold files for adding a new benchmark to SkillOpt.
|
|
|
|
## Files
|
|
|
|
- `env_template.py` — Environment adapter template
|
|
- `loader_template.py` — Data loader template
|
|
- `config_template.yaml` — Config file template
|
|
|
|
## Usage
|
|
|
|
1. Copy this directory: `cp -r skillopt/envs/_template skillopt/envs/your_benchmark`
|
|
2. Rename files: remove `_template` suffix
|
|
3. Implement the `TODO` sections
|
|
4. Register your adapter in `_ENV_REGISTRY` inside `scripts/train.py`
|
|
5. Create config at `configs/your_benchmark/default.yaml`
|
|
|
|
See the [documentation](../../docs/guide/new-benchmark.md) for the full guide.
|