Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.
Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).
把所有辅助模型配置一遍 尤其是标题生成模型 压缩模型 和视觉模型 主模型并发或者能力不足 会阻塞会话
我用的turbo3的KV Cache 比 q4_0 省显存 性能也更好