The web dashboard (./coli web): a 744B model answering on 6× RTX 5090 —
-live token metrics, the hardware panel, and the VRAM/RAM/disk expert tiers.
The web dashboard (./coli web): a 744B model at 4 tok/s, TTFT 1.6 s, disk 0 —
+full expert residency on 6× RTX 5090, with live token metrics, the per-turn time breakdown,
+the VRAM/RAM/disk tier bar and the live mini-brain in the corner.
@@ -32,6 +33,13 @@ live token metrics, the hardware panel, and the VRAM/RAM/disk expert tiers.
brightness is routing heat, and every expert routed in a turn flashes white. Hovering shows the expert's
measured topic affinity.
+ 
+
The Atlas page: the measured expert atlas +as a 3-D galaxy — 13,260 characterised experts, 1,041 replicated specialists clustering by topic +(poetry, law, Chinese, SQL…). Position is measured routing affinity, not a learned embedding. Drag to spin.
+ ## The idea A 744B Mixture-of-Experts model activates only ~40B parameters per token — and diff --git a/docs/api.md b/docs/api.md index c1f46d0..d3b09f1 100644 --- a/docs/api.md +++ b/docs/api.md @@ -98,3 +98,13 @@ The dashboard talks to the engine over a small line protocol and plain JSON endpoints — nothing heavier than the engine itself. `web/` is a pure OpenAI-API client (React + TypeScript) and also works against any other compatible endpoint; the terminal `coli chat` remains the first-class interface. + +The layout is responsive down to phone widths, and the sidebar carries the full +telemetry stack — hardware, scheduler, tier bar, per-turn time breakdown, tok/s +trend and per-GPU expert counts: + +
+ 
+
+ 
+