ZacharyZcR c3a90eca36 profile CPU GPU tier execution costs

2026-07-18 04:54:59 +08:00

..

audit_win_shims.c

Windows 11 native port, phase 1: MinGW-w64 static build, compat shims, setup + docs (#40)

2026-07-11 12:59:49 +02:00

bench_dsa_select.c

sampling: partial top-keep select in attention_rows DSA — O(nk) quickselect, not O(nk log nk) qsort (#356)

2026-07-17 09:54:40 -04:00

bench_tensor_core.cu

Unify continuous batching + heterogeneous runtime: decode batching, physical-core planning, disjoint VRAM/RAM placement, topp-policy warning (CPU-validated, CUDA on 6x5090) (#68)

2026-07-13 14:30:36 +02:00

bench_topp.c

bench: add bench_topp -- head-to-head old-qsort vs new-heap timing on V=151936 (#335)

2026-07-17 09:22:26 -04:00

test_backend_cuda.cu

placement: full-resident experts on large-memory hosts — CUDA_EXPERT_GB=auto, PIN_GB=all, adaptive GPU slots, RoPE cache (#80)

2026-07-14 16:35:39 +02:00

test_backend_metal.mm

Metal backend (Apple Silicon): batched experts + fused attention on GPU, unified-memory zero-copy, gated behind COLI_METAL — 2.06 tok/s M5 Max (#72, #87, #103)

2026-07-13 08:57:10 +02:00

test_benchmark_cuda_fixture.py

profile CPU GPU tier execution costs

2026-07-18 04:54:59 +08:00

test_cli_output.py

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67, #85)

2026-07-12 13:38:40 +02:00

test_compat_direct.c

windows: PIPE default ON + compat_fadvise WILLNEED cache-warmer (pread path)

2026-07-15 06:14:15 -04:00

test_decode_batch.c

Unify continuous batching + heterogeneous runtime: decode batching, physical-core planning, disjoint VRAM/RAM placement, topp-policy warning (CPU-validated, CUDA on 6x5090) (#68)

2026-07-13 14:30:36 +02:00

test_doctor.py

doctor: platform-aware engine.binary check — Windows has no X_OK bit (#178, fixes #141)

2026-07-14 13:49:17 +02:00

test_dsa_select.c

sampling: partial top-keep select in attention_rows DSA — O(nk) quickselect, not O(nk log nk) qsort (#356)

2026-07-17 09:54:40 -04:00

test_env_defaults.py

coli: measured Windows launcher defaults — OMP tuning parity + DIRECT/PIPE/PILOT_REAL

2026-07-15 12:06:48 -05:00

test_grammar.c

Grammar-forced speculative drafts: GBNF grammar as a third draft source, guaranteed-accepted forced spans, lossless + opt-in (#48, #70)

2026-07-12 01:35:39 +02:00

test_i4_acc512.c

expert dot: AVX-512 int4→float accumulator, runtime-switchable (I4_ACC512), +7% CPU-heavy decode, more accurate than AVX2 order (#95)

2026-07-13 15:24:25 +02:00

test_i4_grouped.c

tests: extend the fmt=4 oracle to the fused gate+up kernel (#298)

2026-07-16 17:27:06 +02:00

test_idot.c

ARM i8mm: SMMLA fast path for the int8/int4 IDOT drivers

2026-07-15 14:59:06 +01:00

test_json.c

Local project checks and contribution templates: make check, dependency-free C/python tests, issue forms + blank issues, CONTRIBUTING (#20)

2026-07-10 08:56:41 +02:00

test_kv_alloc.c

tests: kv_alloc re-allocation regression test

2026-07-15 00:32:58 +01:00

test_makefile_platform.py

fix(build): handle portable detection edge cases

2026-07-15 22:19:25 -05:00

test_openai_server.py

Profiling page: per-turn phase timings, live in the web dashboard

2026-07-16 08:56:12 -04:00

test_pipe_cuda.cu

GPU resident pipeline: batch CUDA attention, head-sharded kv_b, prefill expert groups, W4A16 mixed dispatch (#111)

2026-07-14 18:18:05 +02:00

test_resource_plan.py

coli: measured Windows launcher defaults — OMP tuning parity + DIRECT/PIPE/PILOT_REAL

2026-07-15 12:06:48 -05:00

test_schema_gbnf.c

SCHEMA=<file.json>: JSON-Schema -> GBNF compiler for grammar-forced drafts (#148)

2026-07-14 16:31:09 +02:00

test_st_pread.c

test_st_pread: Windows-compatible — relative tmpdir, fork subtest gated POSIX

2026-07-16 16:32:43 -04:00

test_st.c

Local project checks and contribution templates: make check, dependency-free C/python tests, issue forms + blank issues, CONTRIBUTING (#20)

2026-07-10 08:56:41 +02:00

test_stops.c

tests: test_stops must not assume /tmp exists (fixes the windows job)

2026-07-16 20:08:02 +02:00

test_tier.c

Unify continuous batching + heterogeneous runtime: decode batching, physical-core planning, disjoint VRAM/RAM placement, topp-policy warning (CPU-validated, CUDA on 6x5090) (#68)

2026-07-13 14:30:36 +02:00

test_tok.c

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67, #85)

2026-07-12 13:38:40 +02:00

test_topp.c

sampling: partial top-p select in dist_build — O(V) heapify + k pops, not O(V log V) qsort (#335)

2026-07-17 09:01:23 -04:00

test_uring.c

use async and fix workers

2026-07-15 12:42:13 +02:00