Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.
Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).
我要奔溃啦！一直没有跑通！
太帅了！ 是 KV 缓存显存问题——27B Q4 模型（约 18GB）+ 128K 上下文 × q8_0 KV 会把 7900XTX 的 24GB 撑爆，KV 溢出到内存导致极慢。先确认，然后按你说的换 q4_0。我的 Q8 根本跑不动
G