Files

T

woolcoxm 789169f8f9 convert: fix converter crashes on Windows (fcntl import, null config) (#185 )

Three crash bugs in convert_fp8_to_int4.py, all on the download path:

P3: 'import fcntl' at line 211 is Unix-only — ModuleNotFoundError on Windows.
    The --indir test path returns before reaching it so tests pass, but
    '--repo' on Windows hard-crashes. Guarded the import: try fcntl (Unix),
    fall back to msvcrt.locking (Windows), skip if neither available.

P4: repo_info retry loop had range(999) — up to ~16 hours of retries on a
    bad network, then fell through to line 395 where 'info' was unbound
    (NameError). Capped at 10 retries and added an explicit error + return
    when exhausted. Also added an early return if no safetensors shards are
    found in the repo.

P5: if the shards list was empty (wrong repo, all filtered out), the
    'for i, sh in enumerate(shards)' loop never executed and 'i' was unbound
    at line 460 (NameError). Now caught by the early return from P4.

Co-authored-by: woolcoxm <13604288+woolcoxm@users.noreply.github.com>

2026-07-14 14:11:47 +02:00

__init__.py

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

benchmark_cuda_fixture.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

clean.py

Makefile: portable clean/test-c via python helpers — works without sh.exe on native Windows (#179 , fixes #172 )

2026-07-14 13:49:26 +02:00

convert_fp8_to_int4.py

convert: fix converter crashes on Windows (fcntl import, null config) (#185 )

2026-07-14 14:11:47 +02:00

convert_olmoe.py

Windows 11 native port, phase 1: MinGW-w64 static build, compat shims, setup + docs (#40 )

2026-07-11 12:59:49 +02:00

download_glm52.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

eval_glm.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

fetch_benchmarks.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

gen_unicode.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

make_glm_bench_model.py

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

make_glm_oracle.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

quant_ablation.py

quant_ablation: condition GLM contexts on [gMASK]<sop> for in-distribution scoring (#155 )

2026-07-14 14:11:15 +02:00

README.md

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

run_tests.py

Makefile: portable clean/test-c via python helpers — works without sh.exe on native Windows (#179 , fixes #172 )

2026-07-14 13:49:26 +02:00

README.md

Tools

These scripts support model preparation and offline engineering work. They are not runtime dependencies of the C engine.

convert_fp8_to_int4.py, download_glm52.py: model preparation
make_glm_oracle.py, make_glm_bench_model.py: deterministic fixtures
benchmark_cuda_fixture.py, eval_glm.py, fetch_benchmarks.py: benchmarks
gen_unicode.py: tokenizer table generation

Run them from c/, for example:

python3 tools/convert_fp8_to_int4.py --selftest
python3 tools/make_glm_bench_model.py --output /tmp/colibri-bench