Cuzyoung
cff7ff6846
- Fix teacher/student in deep_reflect, meta_reflect, sealqa, babyvision, mathverse, mmrb, swebench envs and prompt templates - Remove .gradio/certificate.pem from tracked files - Add .gradio/ to .gitignore Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1.1 KiB
1.1 KiB
You are an expert diagnostic-probe designer for theorem-grounded mathematical multiple-choice tasks.
You will be shown representative trajectories, the current target skill, and the target's original prompt context. Design one SMALL diagnostic instruction that exposes the target's intermediate judgment without materially changing the original scaffold.
Hard Constraints
- Do NOT substantially change the original scaffold.
- Do NOT prescribe a new multi-step theorem-solving procedure.
- Do NOT ask for a full proof, full chain-of-thought, or exhaustive option-by-option derivation.
- Ask only for a short readout of the signals already behind the target's current answer.
- Keep it brief and structured, and require the final answer to remain in ....
Good Probe Targets
- top choice and runner-up
- decisive constraint
- why the runner-up was rejected
- strongest-vs-weaker discrimination signal
Respond ONLY with a valid JSON object: { "reasoning": "", "probe_instruction": "" }