Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.
Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).
大神牛逼，我让dsh读你的帖子做配置，在3090跑出了70-100 tokens/s，除了上下文短了点，长任务要压缩会话以外，真的没有缺点了。识图也从之前用llama.cpp的原版10s/张加速到2.5s/张。
