Commit Graph

  • 289befb0fd coli: multi-model registry + picker (coli models / chat menu); README: MoE-only model roadmap (gpt-oss-120b next) JustVugg 2026-07-07 12:59:56 +02:00
  • b71d3884f6 coli bench: self-contained (venv python + auto-fetch datasets); README calls for a quality run on faster hardware JustVugg 2026-07-07 07:29:52 +02:00
  • 193d2ce92d DSA lightning indexer: full implementation with auto-detection JustVugg 2026-07-06 22:07:50 +02:00
  • dd8c907800 macOS/Apple Silicon port: NEON kernels + platform shim (PR #1 by RDouglasSharp) RDouglas 2026-07-06 21:01:12 +01:00
  • 8d7fbef39c README: today's engine work (integer kernels, MLA absorption, readahead, sampling, DSA status) JustVugg 2026-07-06 20:24:18 +02:00
  • 7a5ffd192d async I/O: WILLNEED readahead of the next expert block while computing the current one JustVugg 2026-07-06 19:56:24 +02:00
  • 757b0a8369 MLA weight absorption for decode (S<=4): no per-token k/v reconstruction — score via (W_K^T q)·latent, ctx via W_V(Σ a·latent). Validated exact: f32 TF 32/32, gen 20/20 with ABSORB=1 forced JustVugg 2026-07-06 19:54:51 +02:00
  • 741f49a1ca integer-dot kernels (Q8_0-style activations, AVX2 maddubs): int8 always, int4 when S>=2 — measured 1.4-2.5x JustVugg 2026-07-06 19:50:02 +02:00
  • 34fb900762 README: honest matmul-bound predictions (GFLOP math), updated sampling defaults JustVugg 2026-07-06 19:40:27 +02:00
  • 2dd6800aea sampling defaults for int4 reality: temp 0.7, nucleus 0.90 (official 1.0/0.95 tuned for full precision; the int4 tail is quantization noise) JustVugg 2026-07-06 19:30:34 +02:00
  • 1a8d2bcff3 prefill progress: engine reports layer N/78 on stderr, coli spinner shows it live JustVugg 2026-07-06 18:18:50 +02:00
  • 3278ea78d0 reserve 2.5 GB for the page cache in the RAM budget: starving it drops buffered reads 800->180 MB/s (measured) JustVugg 2026-07-06 18:00:35 +02:00
  • e982d2930e autopin: pin share scales with usage-history confidence JustVugg 2026-07-06 17:26:08 +02:00
  • b56d58d388 coli: user box adapts to multi-line messages; status lines one per row without paths JustVugg 2026-07-06 17:24:45 +02:00
  • afcd71ab1c surface MTP/USAGE status in coli chat banner (stderr) JustVugg 2026-07-06 17:03:49 +02:00
  • b2855c0da1 coli convert: one command does model + MTP head; README documents the full zero-to-chat path JustVugg 2026-07-06 16:59:27 +02:00
  • 3e88e37ba2 learning cache + true sampling + DSA indexer extraction mode JustVugg 2026-07-06 12:29:13 +02:00
  • 257c4d0a8b serve: :piu resumes a truncated answer from live KV; ngen default 1024 (stops end turns now) JustVugg 2026-07-06 11:54:18 +02:00
  • 8e8d5fb02b Update README.md Vincenzo 2026-07-05 23:22:23 +02:00
  • ea27cd77fb Update README.md Vincenzo 2026-07-05 23:18:00 +02:00
  • 1e33e9b17d Update README.md Vincenzo 2026-07-05 23:16:58 +02:00
  • 31d91b2c5b README: TUI pixel-art hummingbird as SVG logo banner JustVugg 2026-07-05 21:15:09 +02:00
  • 20008742bf README: try-it-on-better-hardware guide + predictions + support section; drop stage-0 research scripts from repo JustVugg 2026-07-05 21:02:46 +02:00
  • 1ae22a6135 colibrì: pure-C GLM-5.2 (744B MoE) engine with disk-streamed experts JustVugg 2026-07-05 20:52:05 +02:00
  • a6deef8e44 Initial commit Vincenzo 2026-07-01 14:27:49 +02:00