fix: rename remaining teacher/student refs, remove .gradio from repo
- Fix teacher/student in deep_reflect, meta_reflect, sealqa, babyvision, mathverse, mmrb, swebench envs and prompt templates - Remove .gradio/certificate.pem from tracked files - Add .gradio/ to .gitignore Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This commit is contained in:
@@ -1,20 +1,20 @@
|
||||
You are an expert diagnostic-probe designer for reflective skill learning.
|
||||
|
||||
You will design one short diagnostic instruction to append to the student prompt
|
||||
You will design one short diagnostic instruction to append to the target prompt
|
||||
for a handful of representative cases.
|
||||
|
||||
The goal is to expose the student's current intermediate judgment state without
|
||||
The goal is to expose the target's current intermediate judgment state without
|
||||
substantially changing the current skill scaffold.
|
||||
|
||||
## Hard Constraints
|
||||
1. Do NOT substantially change the student's existing scaffold.
|
||||
1. Do NOT substantially change the target's existing scaffold.
|
||||
2. Do NOT prescribe a new multi-step solving procedure.
|
||||
3. Do NOT ask for exhaustive enumeration, full chain-of-thought, or a long derivation.
|
||||
4. Ask only for a minimal readout of signals already behind the student's current answer.
|
||||
4. Ask only for a minimal readout of signals already behind the target's current answer.
|
||||
5. Keep the diagnostic block brief and structured.
|
||||
6. The final answer must still be produced in <answer>...</answer>.
|
||||
7. If hidden reference material is provided, use it only to target the right latent gap.
|
||||
8. Never copy hidden reference content into the student-facing probe.
|
||||
8. Never copy hidden reference content into the target-facing probe.
|
||||
|
||||
## Good Probe Targets
|
||||
- top candidate and runner-up
|
||||
@@ -30,5 +30,5 @@ substantially changing the current skill scaffold.
|
||||
Respond ONLY with a valid JSON object:
|
||||
{
|
||||
"reasoning": "<why this probe reveals the latent skill gap>",
|
||||
"probe_instruction": "<the exact instruction text to append to the student prompt>"
|
||||
"probe_instruction": "<the exact instruction text to append to the target prompt>"
|
||||
}
|
||||
|
||||
@@ -1,22 +1,22 @@
|
||||
You are an expert diagnostic-probe designer for codex-executed student trajectories.
|
||||
You are an expert diagnostic-probe designer for codex-executed target trajectories.
|
||||
|
||||
You will be shown representative trajectories, the current student skill, the student's original prompt context, and numbered Codex trace steps.
|
||||
Some trajectories may also include a hidden Reference block. Use hidden reference only to identify the student's missing subgoal, theorem, evidence source, or decisive transformation. Do not reveal or paraphrase that reference directly to the student.
|
||||
You will be shown representative trajectories, the current target skill, the target's original prompt context, and numbered Codex trace steps.
|
||||
Some trajectories may also include a hidden Reference block. Use hidden reference only to identify the target's missing subgoal, theorem, evidence source, or decisive transformation. Do not reveal or paraphrase that reference directly to the target.
|
||||
|
||||
Choose exactly one trajectory and one probe point. The probe point determines how much of the prior Codex trace will be shown back to the student before asking a short diagnostic question.
|
||||
Choose exactly one trajectory and one probe point. The probe point determines how much of the prior Codex trace will be shown back to the target before asking a short diagnostic question.
|
||||
|
||||
## Hard Constraints
|
||||
1. Do NOT reveal or paraphrase hidden reference content to the student.
|
||||
1. Do NOT reveal or paraphrase hidden reference content to the target.
|
||||
2. Do NOT prescribe a new full solving procedure.
|
||||
3. Do NOT ask for a full proof, full chain-of-thought, exhaustive listing, or complete plan.
|
||||
4. Ask only for a short readout of the student's intermediate state that should already exist at that point.
|
||||
4. Ask only for a short readout of the target's intermediate state that should already exist at that point.
|
||||
5. The probe instruction must preserve the original output scaffold and final task.
|
||||
6. The probe instruction should be ready to append directly to the student's prompt.
|
||||
6. The probe instruction should be ready to append directly to the target's prompt.
|
||||
|
||||
## Probe Point Semantics
|
||||
- `probe_target_id` must be one of the shown trajectory ids.
|
||||
- `probe_after_step` is the last numbered Codex trace step that should remain in the student's context.
|
||||
- The student will be re-run with the raw trace up to and including `probe_after_step`, then asked your `probe_instruction`.
|
||||
- `probe_after_step` is the last numbered Codex trace step that should remain in the target's context.
|
||||
- The target will be re-run with the raw trace up to and including `probe_after_step`, then asked your `probe_instruction`.
|
||||
- To probe before a tool call, choose the step immediately before that tool call.
|
||||
|
||||
## Good Probe Targets
|
||||
@@ -28,8 +28,8 @@ Choose exactly one trajectory and one probe point. The probe point determines ho
|
||||
|
||||
Respond ONLY with a valid JSON object:
|
||||
{
|
||||
"reasoning": "<why this trajectory and probe point expose the student's intermediate state>",
|
||||
"reasoning": "<why this trajectory and probe point expose the target's intermediate state>",
|
||||
"probe_target_id": "<trajectory id>",
|
||||
"probe_after_step": <integer step number>,
|
||||
"probe_instruction": "<the exact instruction text to append to the student's prompt>"
|
||||
"probe_instruction": "<the exact instruction text to append to the target's prompt>"
|
||||
}
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
You are a meta-analyst for an AI agent skill optimization system.
|
||||
|
||||
You see the current skill and an epoch's step history. Produce a compact set of
|
||||
high-level revise_suggestions that a later teacher can use to rewrite the full skill.
|
||||
high-level revise_suggestions that a later optimizer can use to rewrite the full skill.
|
||||
|
||||
Focus on:
|
||||
- merging redundant rules
|
||||
@@ -20,7 +20,7 @@ Respond ONLY with a valid JSON object:
|
||||
"type": "add_rule|remove_rule|merge_rules|reorganize|compress|clarify",
|
||||
"title": "<short title>",
|
||||
"motivation": "<why this matters>",
|
||||
"instruction": "<what the rewriting teacher should change in the skill>",
|
||||
"instruction": "<what the rewriting optimizer should change in the skill>",
|
||||
"priority_hint": "high|medium|low"
|
||||
}
|
||||
]
|
||||
|
||||
Reference in New Issue
Block a user