@asd2667 试了一下,现在是不能开mtp的……速度太慢了……Found it. The truth:
Warm TTFT is actually fine: your unique 37-token prompt just processed at 29.6 tok/s (1.25s).
The 2.5 tok/s you hit was the first request after the restart — one-time CUDA-graph + MTP draft compilation. That's a cold-start cost, not steady-state.
But I also found MTP is hurting, not helping on this 16GB setup:
Decode: 12.8 tok/s with MTP vs 18.9 tok/s without it earlier (the draft compute overhead exceeds the speculative gain at these speeds; draft acceptance mean was only ~2.3).
MTP adds the cold-start compile overhead you felt.
So per the official page, MTP was meant for the bigger M-model on larger VRAM. On your XS-Pro/16GB it's net-negative. I'll disable MTP, keep the rest of the recommended config (q8/q4 KV, flash-attn, 64k, checkpoints, sampling), and pre-warm so you never hit the cold start: