feat(plugins): ship SkillOpt-Sleep for Claude Code, Codex, and Copilot

Restructure into plugins/{claude-code,codex,copilot}/ — one engine, three thin shells, all calling the shared plugins/run-sleep.sh -> python -m skillopt_sleep. - claude-code/: existing plugin moved here; runner delegates to the shared launcher (fixes repo-root resolution after the move). - codex/: ~/.codex/prompts/sleep.md custom prompt + ~/.agents/skills SKILL.md + install.sh + AGENTS.md hint — Codex's documented, stable extension surfaces. - copilot/: a stdlib-only MCP server (mcp_server.py) exposing sleep_* tools, plus mcp-config.example.json and a copilot-instructions snippet. Verified end to end (initialize -> tools/list -> tools/call returns real engine output). - plugins/README.md overview table; main README News + a dedicated SkillOpt-Sleep section; pyproject lists skillopt_sleep as a first-class package. Decoupling emphasized throughout: open-source tool (skillopt_sleep/) with zero dependency on the research package. 29 tests pass; all three shells resolve. Co-Authored-By: Claude Opus 4 <noreply@anthropic.com>
2026-06-08 14:31:52 +00:00
parent b02ffc2c99
commit f9db99853b
22 changed files with 576 additions and 31 deletions
@@ -0,0 +1,59 @@
+# SkillOpt-Sleep — Codex integration
+
+Give your **Codex** agent a nightly **sleep cycle**: it reviews past sessions
+offline, replays your recurring tasks on your own Codex budget, and consolidates
+what it learns into validated memory + skills behind a held-out gate. Same engine
+as the Claude Code plugin (`skillopt_sleep`), wrapped for Codex.
+
+> **Verified on Codex:** on the public
+> [gbrain-evals](https://github.com/garrytan/gbrain-evals) `skillopt-v1`
+> benchmark, a deliberately deficient skill goes **0.00 → 1.00** on a held-out
+> set with the Codex backend (incl. the tool-use seed via a real tool loop).
+> See [`../../docs/sleep/FINAL_REPORT.md`](../../docs/sleep/FINAL_REPORT.md).
+
+## What Codex supports (and what we use)
+
+Codex (`@openai/codex`) extends via **`AGENTS.md`** instructions, **skills** at
+`~/.agents/skills/<name>/SKILL.md`, and **custom prompts** at
+`~/.codex/prompts/<name>.md` (invoked as `/<name>`). This integration ships all
+three, plus a shared runner.
+
+## Install
+
+```bash
+git clone <repo-url> SkillOpt-Sleep
+cd SkillOpt-Sleep
+bash plugins/codex/install.sh          # installs the /sleep prompt + skill
+export SKILLOPT_SLEEP_REPO="$(pwd)"    # so the runner is found from anywhere
+```
+
+Requires Python ≥ 3.10 and the `codex` CLI on PATH.
+
+## Use
+
+```text
+/sleep status      # what's happened
+/sleep dry-run     # safe preview, stages nothing
+/sleep run         # full cycle, stages a reviewed proposal (no live edits)
+/sleep adopt       # apply the staged proposal (with backup)
+```
+
+Or call the engine directly:
+
+```bash
+python -m skillopt_sleep run --project "$(pwd)" --backend codex
+```
+
+Default backend is `mock` (no API spend). `--backend codex` uses your Codex
+budget for real improvement. All the controllable knobs (`--gate on|off`,
+`--rollouts-k`, `--budget-tokens`, `--preferences`, optimizer/target split) work
+identically — see [`../../docs/sleep/CONTROLLABLE_DREAMING.md`](../../docs/sleep/CONTROLLABLE_DREAMING.md).
+
+## Notes / status
+
+- Codex's `exec` runs shell, so the real-tool-loop replay (e.g. the
+  `tool_called: search` benchmark seed) works natively.
+- Codex's standalone *plugin-package manifest* format is not yet a stable public
+  spec; this integration uses the documented `AGENTS.md` + skills + prompts
+  mechanisms, which are stable. If/when a `codex plugin` package format ships,
+  we'll add a one-file manifest.
@@ -0,0 +1,36 @@
+#!/usr/bin/env bash
+# Install the SkillOpt-Sleep Codex integration into the user's ~/.codex and
+# ~/.agents directories. Idempotent; prints what it does.
+set -euo pipefail
+
+REPO_ROOT="$(cd "$(dirname "${BASH_SOURCE[0]}")/../.." && pwd)"
+CODEX_HOME="${CODEX_HOME:-$HOME/.codex}"
+AGENTS_SKILLS="${HOME}/.agents/skills"
+
+echo "[install] repo: $REPO_ROOT"
+
+# 1) custom /sleep prompt
+mkdir -p "$CODEX_HOME/prompts"
+cp "$REPO_ROOT/plugins/codex/prompts/sleep.md" "$CODEX_HOME/prompts/sleep.md"
+echo "[install] /sleep prompt   -> $CODEX_HOME/prompts/sleep.md"
+
+# 2) user-level skill
+mkdir -p "$AGENTS_SKILLS/skillopt-sleep"
+cp "$REPO_ROOT/plugins/codex/skills/skillopt-sleep/SKILL.md" "$AGENTS_SKILLS/skillopt-sleep/SKILL.md"
+echo "[install] skill           -> $AGENTS_SKILLS/skillopt-sleep/SKILL.md"
+
+# 3) record the repo location so the runner is found from anywhere
+echo "[install] add to your shell profile:"
+echo "    export SKILLOPT_SLEEP_REPO=\"$REPO_ROOT\""
+
+# 4) optional: append an AGENTS.md hint (only if the user opts in)
+cat <<EOF
+
+[install] Optional — add this to ~/.codex/AGENTS.md so Codex always knows the tool:
+
+  ## SkillOpt-Sleep
+  An offline self-improvement cycle is available. To run it:
+  \`bash "$REPO_ROOT/plugins/run-sleep.sh" status\`. Use \`/sleep\` for the guided flow.
+
+Done. Try:  /sleep status
+EOF
@@ -0,0 +1,21 @@
+# /sleep — SkillOpt-Sleep for Codex
+#
+# Custom prompt: copy this file to ~/.codex/prompts/sleep.md and invoke with
+# `/sleep` in the Codex CLI. ($ARGUMENTS is the text after /sleep.)
+
+Run the SkillOpt-Sleep offline self-evolution cycle. Action: $ARGUMENTS
+(empty → "status").
+
+Use the bundled runner via shell:
+
+    bash "${SKILLOPT_SLEEP_REPO:?set SKILLOPT_SLEEP_REPO to the repo root}/plugins/run-sleep.sh" $ARGUMENTS --project "$(pwd)"
+
+Then:
+- For `run`/`dry-run`: read the staged `report.md` and show the held-out
+  baseline → candidate score and the proposed edits. `run` only stages a
+  proposal; nothing live changes until `adopt`.
+- For `adopt`: confirm which files were updated and that a backup was written.
+- Never edit the user's AGENTS.md / skills yourself; only `adopt` does that.
+
+Default backend is `mock` (no API spend). Add `--backend codex` for real
+improvement on the user's Codex budget.
@@ -0,0 +1,49 @@
+---
+name: skillopt-sleep
+description: Nightly offline self-evolution for a Codex agent. Reviews past sessions, replays recurring tasks, and consolidates validated memory + skills behind a held-out gate. Use when the user wants Codex to learn from past usage, run a "sleep"/"dream" cycle, or schedule offline self-optimization.
+---
+
+# SkillOpt-Sleep (Codex skill)
+
+This skill drives the `skillopt_sleep` engine — an offline "sleep cycle" that
+makes a Codex agent better at the user's recurring work without retraining.
+
+## When to use
+
+Trigger when the user wants to: review past sessions, learn their preferences,
+consolidate feedback into long-term memory/skills, run a nightly/offline
+self-improvement cycle, or adopt a staged proposal.
+
+## How to run it
+
+Invoke the bundled runner via shell (Codex `exec` has shell access). The runner
+finds the engine and a Python ≥ 3.10 automatically:
+
+```bash
+# point at the repo if it isn't auto-detected from CWD:
+export SKILLOPT_SLEEP_REPO=/path/to/SkillOpt-Sleep
+bash "$SKILLOPT_SLEEP_REPO/plugins/run-sleep.sh" <action> --project "$(pwd)"
+```
+
+`<action>` ∈ `status | dry-run | run | adopt | harvest`. Use `--backend codex`
+for real improvement on the user's own Codex budget (default `mock` = no spend).
+
+## Steps
+
+1. Run the requested action; capture stdout.
+2. For `run`/`dry-run`: read the staged `report.md` it prints and show the user
+   the held-out baseline → candidate score and the exact proposed edits.
+3. `run` only **stages** a proposal under `<project>/.skillopt-sleep/staging/`;
+   nothing live changes until `adopt`. Offer `/sleep adopt`.
+4. Never hand-edit the user's `AGENTS.md` / skills yourself — only `adopt` does,
+   and it backs up first.
+
+## Validate
+
+```bash
+python -m skillopt_sleep.experiments.run_gbrain --backend codex \
+  --seeds brief-writer --data-root /path/to/gbrain-evals/eval/data/skillopt-v1 \
+  --nights 2 --limit-replay 3 --limit-holdout 3
+```
+A deficient skill goes 0.00 → 1.00 on a held-out set; the optimizer's edits are
+gated on real-task performance.