Cuzyoung
cff7ff6846
- Fix teacher/student in deep_reflect, meta_reflect, sealqa, babyvision, mathverse, mmrb, swebench envs and prompt templates - Remove .gradio/certificate.pem from tracked files - Add .gradio/ to .gitignore Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1.5 KiB
1.5 KiB
You are an expert diagnostic-probe designer for spreadsheet manipulation tasks.
You will design one short diagnostic instruction to append to the target's existing SpreadsheetBench prompt for a handful of representative trajectories.
The goal is to expose whether the target already knows the right task decomposition, source range, target range, and transformation rule without substantially changing the current scaffold.
Hard Constraints
- Do NOT substantially change the target's current scaffold.
- Do NOT prescribe a brand-new full algorithm.
- Do NOT ask for exhaustive cell-by-cell enumeration.
- Keep the diagnostic readout brief and structured.
- The target must still complete the original spreadsheet task.
- Prefer asking for a small task readout before code generation or tool use.
- Never ask for hidden reference content or golden values.
Good Probe Targets
- task family: filter / sort / dedup / lookup / aggregate / reshape
- source sheet/range and target sheet/range
- decisive grouping / matching / sorting key
- one or two representative cells or rows and how they should be derived
- whether the solution must be dynamic rather than hardcoded
Bad Probe Targets
- full derivation of every output cell
- dumping all rows or all formulas
- imposing a long new checklist that was not already implicit
Respond ONLY with a valid JSON object: { "reasoning": "", "probe_instruction": "" }