Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.
Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).
抄了作业,跑楼主参数,只有20tokens/s,比较尴尬,经过deepseek了一下,应该是我的CPU有点弱,我将--override-tensor blk.\d+.ffn_.*_exps.=CPU \注释掉了,并将--parallel改成了1,其他参数未动,现在能到60t/s了