Files

T

bokiko 5230717cf4 eval: default the [gMASK]<sop> prefix ON for GLM snapshots (#108 )

Scoring raw completions without GLM's training-time prefix runs the model
out-of-distribution: scores drop and A/B sensitivity distorts (#108). Detect
GLM via config.json model_type and prepend automatically, with a stderr
notice. EVAL_PREFIX (including empty) still overrides for research use.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

2026-07-14 17:36:48 +03:00

__init__.py

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

benchmark_cuda_fixture.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

clean.py

Makefile: portable clean/test-c via python helpers — works without sh.exe on native Windows (#179 , fixes #172 )

2026-07-14 13:49:26 +02:00

convert_fp8_to_int4.py

convert: NVFP4 (modelopt e2m1) dequant path for convert_fp8_to_int4.py (#83 )

2026-07-14 14:12:49 +02:00

convert_olmoe.py

Windows 11 native port, phase 1: MinGW-w64 static build, compat shims, setup + docs (#40 )

2026-07-11 12:59:49 +02:00

download_glm52.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

eval_glm.py

eval: default the [gMASK]<sop> prefix ON for GLM snapshots (#108 )

2026-07-14 17:36:48 +03:00

fetch_benchmarks.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

gen_unicode.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

make_glm_bench_model.py

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

make_glm_oracle.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

quant_ablation.py

quant_ablation: condition GLM contexts on [gMASK]<sop> for in-distribution scoring (#155 )

2026-07-14 14:11:15 +02:00

README.md

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

run_tests.py

Makefile: portable clean/test-c via python helpers — works without sh.exe on native Windows (#179 , fixes #172 )

2026-07-14 13:49:26 +02:00

README.md

Tools

These scripts support model preparation and offline engineering work. They are not runtime dependencies of the C engine.

convert_fp8_to_int4.py, download_glm52.py: model preparation
make_glm_oracle.py, make_glm_bench_model.py: deterministic fixtures
benchmark_cuda_fixture.py, eval_glm.py, fetch_benchmarks.py: benchmarks
gen_unicode.py: tokenizer table generation

Run them from c/, for example:

python3 tools/convert_fp8_to_int4.py --selftest
python3 tools/make_glm_bench_model.py --output /tmp/colibri-bench