<![CDATA[近无损量化 Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp.gguf]]>

<![CDATA[近无损量化 Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp.gguf]]>近无损量化
https://huggingface.co/ISTA-DASLab/collections

Context 131072 VRAM 21GB
llama-cli -m Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp.gguf -ngl 99 --spec-type draft-mtp --spec-draft-n-max 3 -c 131072
RTX3090 [ Prompt: 124.7 t/s | Generation: 56.4 t/s ]

Context 65536 VRAM 17GB
llama-cli -m Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp.gguf -ngl 99 --spec-type draft-mtp --spec-draft-n-max 3 -c 65536
RTX3090 [ Prompt: 131.7 t/s | Generation: 59.8 t/s ]

]]>https://lcz.me/topic/1561RSS for NodeWed, 09 Sep 2026 22:53:36 GMTTue, 08 Sep 2026 13:19:26 GMT60<![CDATA[Reply to 近无损量化 Qwen3.8-27B-GSQ-RCO-IQ3_S-mtp.gguf on Tue, 08 Sep 2026 13:24:13 GMT]]>@VS-Studio 试过了，小显存的小卡玩玩就可以。对大显存的来说没必要。

]]>https://lcz.me/post/16688https://lcz.me/post/16688Tue, 08 Sep 2026 13:24:13 GMT