This website requires JavaScript.
289befb0fd
coli: multi-model registry + picker (coli models / chat menu); README: MoE-only model roadmap (gpt-oss-120b next)
JustVugg
2026-07-07 12:59:56 +02:00
b71d3884f6
coli bench: self-contained (venv python + auto-fetch datasets); README calls for a quality run on faster hardware
JustVugg
2026-07-07 07:29:52 +02:00
193d2ce92d
DSA lightning indexer: full implementation with auto-detection
JustVugg
2026-07-06 22:07:50 +02:00
dd8c907800
macOS/Apple Silicon port: NEON kernels + platform shim (PR #1 by RDouglasSharp)
RDouglas
2026-07-06 21:01:12 +01:00
8d7fbef39c
README: today's engine work (integer kernels, MLA absorption, readahead, sampling, DSA status)
JustVugg
2026-07-06 20:24:18 +02:00
7a5ffd192d
async I/O: WILLNEED readahead of the next expert block while computing the current one
JustVugg
2026-07-06 19:56:24 +02:00
757b0a8369
MLA weight absorption for decode (S<=4): no per-token k/v reconstruction — score via (W_K^T q)·latent, ctx via W_V(Σ a·latent). Validated exact: f32 TF 32/32, gen 20/20 with ABSORB=1 forced
JustVugg
2026-07-06 19:54:51 +02:00
741f49a1ca
integer-dot kernels (Q8_0-style activations, AVX2 maddubs): int8 always, int4 when S>=2 — measured 1.4-2.5x
JustVugg
2026-07-06 19:50:02 +02:00
34fb900762
README: honest matmul-bound predictions (GFLOP math), updated sampling defaults
JustVugg
2026-07-06 19:40:27 +02:00
2dd6800aea
sampling defaults for int4 reality: temp 0.7, nucleus 0.90 (official 1.0/0.95 tuned for full precision; the int4 tail is quantization noise)
JustVugg
2026-07-06 19:30:34 +02:00
1a8d2bcff3
prefill progress: engine reports layer N/78 on stderr, coli spinner shows it live
JustVugg
2026-07-06 18:18:50 +02:00
3278ea78d0
reserve 2.5 GB for the page cache in the RAM budget: starving it drops buffered reads 800->180 MB/s (measured)
JustVugg
2026-07-06 18:00:35 +02:00
e982d2930e
autopin: pin share scales with usage-history confidence
JustVugg
2026-07-06 17:26:08 +02:00
b56d58d388
coli: user box adapts to multi-line messages; status lines one per row without paths
JustVugg
2026-07-06 17:24:45 +02:00
afcd71ab1c
surface MTP/USAGE status in coli chat banner (stderr)
JustVugg
2026-07-06 17:03:49 +02:00
b2855c0da1
coli convert: one command does model + MTP head; README documents the full zero-to-chat path
JustVugg
2026-07-06 16:59:27 +02:00
3e88e37ba2
learning cache + true sampling + DSA indexer extraction mode
JustVugg
2026-07-06 12:29:13 +02:00
257c4d0a8b
serve: :piu resumes a truncated answer from live KV; ngen default 1024 (stops end turns now)
JustVugg
2026-07-06 11:54:18 +02:00
8e8d5fb02b
Update README.md
Vincenzo
2026-07-05 23:22:23 +02:00
ea27cd77fb
Update README.md
Vincenzo
2026-07-05 23:18:00 +02:00
1e33e9b17d
Update README.md
Vincenzo
2026-07-05 23:16:58 +02:00
31d91b2c5b
README: TUI pixel-art hummingbird as SVG logo banner
JustVugg
2026-07-05 21:15:09 +02:00
20008742bf
README: try-it-on-better-hardware guide + predictions + support section; drop stage-0 research scripts from repo
JustVugg
2026-07-05 21:02:46 +02:00
1ae22a6135
colibrì: pure-C GLM-5.2 (744B MoE) engine with disk-streamed experts
JustVugg
2026-07-05 20:52:05 +02:00
a6deef8e44
Initial commit
Vincenzo
2026-07-01 14:27:49 +02:00