Files

T

JustVugg 4268e00fa1 security: harden safetensors/JSON parsers against malicious model files

A downloaded (supply-chain) model file was fully trusted by the loader. Three
memory-safety holes, all reachable by pointing the engine at a crafted shard —
demonstrated crashing on pre-fix, now rejected fail-closed:

st.h (safetensors):
- header length `hlen` (u64 from the file) was unbounded before malloc(hlen+1):
  a crafted value overflows (malloc(0) then hdr[hlen]=0 OOB) or forces a giant
  allocation. Now bounded to the file size and a 512 MB cap; malloc NULL-checked.
- json_get() returns NULL for missing/mistyped fields, but dtype/data_offsets/
  shape were dereferenced blind (off->kids[0]) — a header omitting data_offsets
  SIGSEGV'd (verified). Now type/arity-checked before use.
- data_offsets [a0,b0] were trusted: b0<a0 gave a negative nbytes -> malloc((size_t))
  giant and an oversized memcpy into the caller's buffer in st_read_f32 (heap
  overflow); off could point outside the file. Now validated 0<=a0<=b0 and
  data_start+b0<=filesize.

json.h: j_parse_val recursed with no depth limit -> stack overflow on nested
input like [[[[...]]]]. Added J_MAX_DEPTH=1024 (headers are ~3 deep); wide-but-
flat objects like the GLM header are unaffected (depth is decremented per return).

eval_glm.py: tempfile.mktemp() -> mkstemp() — closes the TOCTOU/symlink race on
a shared tmp dir (CWE-377).

Network path (openai_server.py + serve SUBMIT parser) audited separately and is
already sound: hmac.compare_digest auth, MAX_BODY cap, resolve()+relative_to
traversal guard, list-form subprocess, bounded/validated SUBMIT header. All 62
tests pass; valid GLM/OLMoE shards load unchanged.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-07-15 08:13:20 +02:00

expert_atlas

tools: expert_atlas — confound-controlled probe harness for the GLM-5.2 expert atlas (#175 ) (#218 )

2026-07-15 07:41:24 +02:00

__init__.py

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

bench_ux.sh

GPU resident pipeline: batch CUDA attention, head-sharded kv_b, prefill expert groups, W4A16 mixed dispatch (#111 )

2026-07-14 18:18:05 +02:00

benchmark_cuda_fixture.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

clean.py

Makefile: portable clean/test-c via python helpers — works without sh.exe on native Windows (#179 , fixes #172 )

2026-07-14 13:49:26 +02:00

convert_fp8_to_int4.py

convert: NVFP4 (modelopt e2m1) dequant path for convert_fp8_to_int4.py (#83 )

2026-07-14 14:12:49 +02:00

convert_olmoe.py

olmoe: int8 container support (fixes SIGBUS), NEON int8 dot kernels (2.7x on ARM), macOS RSS fix, converter fallback (#187 )

2026-07-14 15:59:49 +02:00

download_glm52.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

eval_glm.py

security: harden safetensors/JSON parsers against malicious model files

2026-07-15 08:13:20 +02:00

expert_atlas.py

GPU resident pipeline: batch CUDA attention, head-sharded kv_b, prefill expert groups, W4A16 mixed dispatch (#111 )

2026-07-14 18:18:05 +02:00

fetch_benchmarks.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

gen_unicode.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

make_glm_bench_model.py

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

make_glm_oracle.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

quant_ablation.py

quant_ablation: condition GLM contexts on [gMASK]<sop> for in-distribution scoring (#155 )

2026-07-14 14:11:15 +02:00

README.md

Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22 )

2026-07-10 10:08:39 +02:00

route_coupling_report.py

routing: cross-layer coupling trace dump + pair-table builder + opt-in coupled prefetch source (#176 )

2026-07-14 16:13:19 +02:00

route_pairs.py

routing: cross-layer coupling trace dump + pair-table builder + opt-in coupled prefetch source (#176 )

2026-07-14 16:13:19 +02:00

run_tests.py

run_tests: normpath test binaries — forward-slash relative paths fail CreateProcess on Windows (#196 )

2026-07-14 18:01:12 +02:00

README.md

Tools

These scripts support model preparation and offline engineering work. They are not runtime dependencies of the C engine.

convert_fp8_to_int4.py, download_glm52.py: model preparation
make_glm_oracle.py, make_glm_bench_model.py: deterministic fixtures
benchmark_cuda_fixture.py, eval_glm.py, fetch_benchmarks.py: benchmarks
gen_unicode.py: tokenizer table generation

Run them from c/, for example:

python3 tools/convert_fp8_to_int4.py --selftest
python3 tools/make_glm_bench_model.py --output /tmp/colibri-bench