Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.
Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).
@Bunsei 我今天刚按你您之前那个帖子把radiance鼓捣成,速度快的简直太离谱了,跟strata完全不是一个量级,prefill都快到7000了,decode比strata也快翻倍了,而且之前strata用的iq3s, 现在这个是4bit权重。 您是怎么把prefill速度再提一截的?快分享一下经验,我要抄作业