woolcoxm
e71d4fbe29
- build_cuda.bat: one-shot nvcc DLL compilation for sm_120 (RTX 5070 Ti) - issue_budget.md: EXPERT_BUDGET research (cap distinct experts/layer, 2x tok/s) - issue_grouped_quant.md: root cause of int4 incoherence (per-row vs group-128 scales) - glm_fp8_emit.py: FP8 e4m3 test weight generator for converter validation
6 lines
441 B
Batchfile
6 lines
441 B
Batchfile
@echo off
|
|
call "C:\Program Files (x86)\Microsoft Visual Studio\2022\BuildTools\VC\Auxiliary\Build\vcvars64.bat"
|
|
cd /d C:\Users\Mark\Desktop\Projects\colibri\c
|
|
"C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\bin\nvcc" -O3 -std=c++17 -arch=sm_120 -Xcompiler=-W3 -shared -DCOLI_CUDA_BUILDING_DLL -L"C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\lib/x64" -lcudart backend_cuda.cu -o coli_cuda.dll
|
|
echo EXITCODE=%ERRORLEVEL%
|