A
am Am
-
安装运行strata 遇到问题，请教一下大家 -
安装运行strata 遇到问题，请教一下大家 -
安装运行strata 遇到问题，请教一下大家 -
安装运行strata 遇到问题，请教一下大家 -
安装运行strata 遇到问题，请教一下大家这个是运行的样子
出错的时候RuntimeError: the engine exited before it was ready (see I:\Strata-main\strata-iq3_xxs.log)Strata - Qwen3.8-Flash-Next on a normal PC (a GPU + system RAM + CPU)
[ok] GPUs: GPU 0 (NVIDIA GeForce RTX 2080 Ti, 22 GB) + GPU 1 (NVIDIA GeForce RTX 2080 Ti, 22 GB) together (layers split auto)
Starting qwen3.8-flash-next-iq3_xxs: it loads about 47 GB into RAM and locks part of it for the GPU.
While it does, YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES (longer the first time after a
restart). That is normal: please wait and don't close this window - the browser opens when it is ready.
Later, closing this window stops the model.Settings (strata-iq3_xxs.json): --expert-cache auto --prefill auto --spec 4 --spec-min-p 0.5
--max-context 131072 --kv int8 --kv-resident 32768; server 127.0.0.1:8080, gpu 0,1, layer_split auto
loading the model (the first start takes a minute or two) ...
[strata] layer split across GPUs [0, 1] (auto)
[strata] starting the engine: reading the model's weights ...
[strata] still starting (20 s) - please wait ...
[strata] loading the experts into RAM (about 47 GB) and locking part of them for the GPU.
YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES NOW - this is normal.
Please wait and don't close this window; the browser opens when it is ready.
[strata] still starting (49 s) - please wait ...
[strata] still starting (69 s) - please wait ...
[strata] still starting (89 s) - please wait ...
[strata] still starting (109 s) - please wait ...
[strata] still starting (129 s) - please wait ...
[strata] still starting (149 s) - please wait ...
[strata] still starting (169 s) - please wait ...
[strata] still starting (189 s) - please wait ...
[strata] still starting (209 s) - please wait ...
[strata] still starting (229 s) - please wait ...
[strata] still starting (249 s) - please wait ...
[strata] still starting (269 s) - please wait ...
[strata] still starting (289 s) - please wait ...
[strata] still starting (309 s) - please wait ...
[strata] still starting (329 s) - please wait ...
[strata] still starting (349 s) - please wait ...
[strata] still starting (369 s) - please wait ...
[strata] still starting (389 s) - please wait ...
[strata] still starting (409 s) - please wait ...
[strata] still starting (429 s) - please wait ...
[strata] still starting (449 s) - please wait ...
[strata] still starting (469 s) - please wait ...
[strata] still starting (489 s) - please wait ...
[strata] still starting (509 s) - please wait ...
[strata] experts loaded: 39.97 GiB at 0.08 GiB/s (522 s so far)
[strata] filling the GPU's expert cache (11260 experts, 16.34 GiB of VRAM) ...
[strata] almost ready ...
Traceback (most recent call last):
File "I:\Strata-main\serve\server.py", line 5895, in <module>
sys.exit(main())
^^^^^^
File "I:\Strata-main\serve\server.py", line 5720, in main
engine = StrataEngine(exe, engine_args(cfg) + (effort_end or []), cwd=cfg.get("cwd"), log=cfg.get("log"),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "I:\Strata-main\serve\server.py", line 693, in init
raise RuntimeError(why + (f" (see {log})" if log else "") +
RuntimeError: the engine exited before it was ready (see I:\Strata-main\strata-iq3_xxs.log)
the engine log's last lines:
strata generate: 11 pool workers on logical processors 2,4,6,8,10,12,14,16,18,20,22, the host thread on 0 (draining too) (--host-core first)
strata generate: expert cache auto: 17.03 GiB free, 700 MiB reserved (+0 MiB for the draft head) -> 7533 slots
strata generate: expert cache 11260 slots, 16.34 GiB of VRAM; policy is
strata generate: the GPU computes the experts in the cache; it rounds differently from the CPU,
so a reply can differ slightly from a run without the cache (same quality:
bench/results/2026-09-27-cache-parity).
PROFILE, ranked by routing frequency, no eviction.
strata generate: pre-filled 11260 of 11260 slots from the profile in 3.4 s (5156 MB/s); slot 0 verified
strata generate: layer split, CUDA1: 15.81 GiB free of 22.00, room for experts 15.04 GiB
strata generate: layer split: CUDA1 runs layers 26-47, expert cache 8190 slots (15.04 GiB), 8190 of its 11264 profiled pairs; slot 0 verified
strata generate: layer split: CUDA0 runs layers 0-25
strata generate: layer split auto: L2 probe: the split is startable on the live free figures
strata generate: R4 hit path ON - resident experts are computed on the GPU
strata generate: 11 expert-pool workers + the host thread
strata generate: session is up (engine 0.1.41)
strata generate: token graph hit path: 19450 resident experts, decided on the device
strata serve: layer split: 79% of the experts resident, the prompt path's streamed ring 96 slots
strata serve: prompt chunk auto: 8192 tokens, a 96-slot ring
strata serve: the prompt path borrows 2429 CUDA0 cache slots (3.50 GiB)
strata serve: CUDA1 prompt path borrows 1905 of its 8190 slots (3.50 GiB)
请按任意键继续. . .