Files

T

tt1203 a3e942516c fix(oracle): create glm_tiny/ before saving so a fresh checkout works

make_glm_oracle.py wrote glm_tiny/model.safetensors and glm_tiny/config.json
without creating the directory first. safetensors.save_file writes a temp file
inside the target dir before the atomic rename, so on a clean checkout (no
pre-existing glm_tiny/) it aborts with an opaque error:

    SafetensorError: Error while serializing: I/O error:
    The system cannot find the path specified. (os error 3)
    at path ".../glm_tiny/.tmpXXXXXX"

The directory only ever existed because it was left over from a previous run,
so the first-ever `python tools/make_glm_oracle.py` fails for every new user
following the README's verify step.

Create glm_tiny/ with Path.mkdir(parents=True, exist_ok=True) before the save
branch — covers the fp8 path, the bf16 path, and config.json. Path is already
imported; no new dependency, no change to the CPU build.

2026-07-16 14:52:16 +01:00

expert_atlas

tools: one expert atlas, not two — retire expert_atlas.py, analyze.py gains --web for the dashboard

2026-07-15 14:16:36 +08:00

__init__.py

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

bench_ux.sh

GPU resident pipeline: batch CUDA attention, head-sharded kv_b, prefill expert groups, W4A16 mixed dispatch (#111 )

2026-07-14 18:18:05 +02:00

benchmark_cuda_fixture.py

benchmark_cuda_fixture: accept the current PROFILE service/wait format

2026-07-15 12:06:14 -05:00

clean.py

Makefile: portable clean/test-c via python helpers — works without sh.exe on native Windows (#179 , fixes #172 )

2026-07-14 13:49:26 +02:00

convert_fp8_to_int4.py

converter: per-tensor-type mixed-precision control

2026-07-15 02:32:12 -04:00

convert_olmoe.py

olmoe: int8 container support (fixes SIGBUS), NEON int8 dot kernels (2.7x on ARM), macOS RSS fix, converter fallback (#187 )

2026-07-14 15:59:49 +02:00

download_glm52.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

eval_glm.py

security: harden safetensors/JSON parsers against malicious model files

2026-07-15 08:13:20 +02:00

fetch_benchmarks.py

bench: survive transient hub errors — retry with backoff, per-task isolation, atomic writes (#304 )

2026-07-16 13:20:35 +03:00

gen_unicode.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

glm_fp8_emit.py

diskio: KV write batching + persistent handle; generators: unfuse experts

2026-07-15 02:32:12 -04:00

make_glm_bench_model.py

diskio: KV write batching + persistent handle; generators: unfuse experts

2026-07-15 02:32:12 -04:00

make_glm_oracle.py

fix(oracle): create glm_tiny/ before saving so a fresh checkout works

2026-07-16 14:52:16 +01:00

quant_ablation.py

tools: E8 lattice quantization for the ablation harness — int{2,3,4,8}[-gN][-e8|-e8u][-rot] (#81 )

2026-07-15 17:24:16 +08:00

README.md

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

route_coupling_report.py

routing: cross-layer coupling trace dump + pair-table builder + opt-in coupled prefetch source (#176 )

2026-07-14 16:13:19 +02:00

route_pairs.py

routing: cross-layer coupling trace dump + pair-table builder + opt-in coupled prefetch source (#176 )

2026-07-14 16:13:19 +02:00

run_tests.py

run_tests: normpath test binaries — forward-slash relative paths fail CreateProcess on Windows (#196 )

2026-07-14 18:01:12 +02:00

README.md

Tools

These scripts support model preparation and offline engineering work. They are not runtime dependencies of the C engine.

convert_fp8_to_int4.py, download_glm52.py: model preparation
make_glm_oracle.py, make_glm_bench_model.py: deterministic fixtures
benchmark_cuda_fixture.py, eval_glm.py, fetch_benchmarks.py: benchmarks
gen_unicode.py: tokenizer table generation

Run them from c/, for example:

python3 tools/convert_fp8_to_int4.py --selftest
python3 tools/make_glm_bench_model.py --output /tmp/colibri-bench