原帖:

https://www.reddit.com/r/LocalLLM/comments/1unmzqc/surprisingly_fast_qwen3635ba3b_on_a_4_gb_vram/

他的脚本参数：

/opt/llama.cpp/build/bin/llama-server \
-m /opt/llama.cpp/models/Qwen3.6-35B-A3B-UDT-Q4_K_XL_MTP.gguf \
--host 0.0.0.0 \
--port 8080 \
-c 64000 \
-ngl 999 \   
--override-tensor "blk\..*\.ffn_(gate_up|gate|up|down)_exps\.weight=CPU"
--flash-attn on \
--cache-type-k q8_0 \
--cache-type-v q8_0 \
--mlock \
-b 3072 \
--ubatch-size 3072 \
-ctxcp 128 \
--reasoning off \
--parallel 1 \
-t 6 \
-tb 12 \
--cache-ram 16384 \
--swa-full \
--no-kv-unified \
--spec-type none \
--cache-reuse 256 \