抡锤者

loading the model (the first start takes a minute or two) ... [strata] starting the engine: reading the model's weights ... [strata] loading the experts the GPU does not hold into RAM (of about 38 GB) and locking part of them for the GPU. YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES NOW - this is normal. Please wait and don't close this window; the browser opens when it is ready. [strata] filling the GPU's expert cache (17148 experts, 22.08 GiB of VRAM) ... [strata] still starting (24 s) - please wait ... [strata] almost ready ... ready: http://192.168.0.3:8080/v1 (OpenAI: /v1/chat/completions, Anthropic: /v1/messages, context 131072 tokens) open http://192.168.0.3:8080/ in a browser to chat; close this window to stop the model from other devices: http://192.168.0.3:8080/ (API: http://192.168.0.3:8080/v1) from other devices: http://172.23.128.1:8080/ (API: http://172.23.128.1:8080/v1) WARNING: no API key - anyone on your network can use this model. Add "api_key": "..." to the config (clients send it as their API key; the web page asks for it) nothing arrives? Windows Firewall blocks it until allowed: accept its prompt for Python, or run in an admin PowerShell: New-NetFirewallRule -DisplayName "Strata 8080" -Direction Inbound -Protocol TCP -LocalPort 8080 -Action Allow -Profile Private (and set this network to Private in Windows' network settings) [strata] reading the prompt: 8,192 of 27,533 tokens, 2 s so far [strata] reading the prompt: 16,384 of 27,533 tokens, 5 s so far [strata] reading the prompt: 24,904 of 27,533 tokens, 8 s so far [strata] reading the prompt: 27,526 of 27,533 tokens, 10 s so far [strata] writing a tool call: terminal: 44 of max 103531 tokens, 113.9 tok/s, 11 s [strata] done: 131 tokens in 12 s (117.8 tok/s) (stop, cancel=False), expert cache 85.4% hit [strata] reading the prompt: 8,192 of 17,916 tokens, 2 s so far [strata] reading the prompt: 16,003 of 17,916 tokens, 5 s so far [strata] reading the prompt: 17,909 of 17,916 tokens, 6 s so far [strata] reading the prompt: 27,960 of 27,967 tokens, 3 s so far [strata] reading the prompt: 4 of max 65536 tokens, 2.6 tok/s, 9 s [strata] writing a tool call: terminal: 52 of max 103097 tokens, 60.5 tok/s, 4 s [strata] writing a tool call: execute_code: 79 of max 65536 tokens, 30.8 tok/s, 10 s [strata] writing a tool call: terminal: 126 of max 103097 tokens, 67.4 tok/s, 5 s [strata] writing a tool call: execute_code: 153 of max 65536 tokens, 42.8 tok/s, 11 s [strata] done: 159 tokens in 5 s (68.2 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] done: 171 tokens in 11 s (42.5 tok/s) (stop, cancel=False), expert cache 88.2% hit [strata] done: 4 tokens in 1 s (70.1 tok/s) (stop, cancel=False), expert cache 94.9% hit [strata] reading the prompt: 19,121 of 19,128 tokens, 2 s so far [strata] writing a tool call: execute_code: 105 of max 65536 tokens, 128.7 tok/s, 3 s [strata] done: 185 tokens in 3 s (150.5 tok/s) (stop, cancel=False), expert cache 96.6% hit [strata] reading the prompt: 27,504 of 32,319 tokens, 2 s so far [strata] reading the prompt: 32,312 of 32,319 tokens, 4 s so far [strata] reading the prompt: 28,256 of 28,263 tokens, 5 s so far [strata] reading the prompt: 4 of max 65536 tokens, 2.9 tok/s, 6 s [strata] writing a tool call: terminal: 59 of max 102801 tokens, 67.2 tok/s, 6 s [strata] done: 79 tokens in 6 s (69.7 tok/s) (stop, cancel=False), expert cache 95.8% hit [strata] writing a tool call: execute_code: 85 of max 65536 tokens, 32.1 tok/s, 7 s [strata] writing a tool call: search_files: 205 of max 65536 tokens, 48.9 tok/s, 9 s [strata] answering: 20 of max 102682 tokens, 49.5 tok/s, 1 s [strata] done: 223 tokens in 9 s (50.4 tok/s) (stop, cancel=False), expert cache 97.9% hit [strata] reading the prompt: 485 of 486 tokens, 1 s so far [strata] answering: 34 of max 102682 tokens, 17.6 tok/s, 3 s [strata] done: 4 tokens in 1 s (35.3 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] reading the prompt: 475 of 476 tokens, 1 s so far [strata] answering: 80 of max 102682 tokens, 22.4 tok/s, 4 s [strata] done: 4 tokens in 1 s (35.6 tok/s) (stop, cancel=False), expert cache 99.2% hit [strata] answering: 124 of max 102682 tokens, 25.1 tok/s, 6 s [strata] done: 4 tokens in 1 s (28.7 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] done: 176 tokens in 6 s (32.6 tok/s) (stop, cancel=False), expert cache 97.1% hit [strata] response_format json_schema: the Python package jsonschema is not installed, so answers are only checked to be one JSON object (python -m pip install "jsonschema>=4.23,<5") [strata] reading the prompt: 844 of 851 tokens, 1 s so far [strata] reading the prompt: 8,192 of 33,834 tokens, 3 s so far [strata] answering: 4 of max 130213 tokens, 1.8 tok/s, 3 s [strata] done: 11 tokens in 4 s (4.8 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] reading the prompt: 16,003 of 33,834 tokens, 6 s so far [strata] reading the prompt: 24,195 of 33,834 tokens, 8 s so far [strata] reading the prompt: 32,387 of 33,834 tokens, 10 s so far [strata] reading the prompt: 33,827 of 33,834 tokens, 12 s so far [strata] reading the prompt: 5 of max 65536 tokens, 8.0 tok/s, 13 s [strata] done: 140 tokens in 14 s (99.5 tok/s) (stop, cancel=False), expert cache 98.7% hit [strata] reading the prompt: 35,836 of 35,843 tokens, 2 s so far [strata] done: 55 tokens in 2 s (193.1 tok/s) (stop, cancel=False), expert cache 98.1% hit [strata] reading the prompt: 38,324 of 38,331 tokens, 2 s so far [strata] writing a tool call: execute_code: 132 of max 65536 tokens, 181.1 tok/s, 3 s [strata] done: 193 tokens in 3 s (180.8 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] reading the prompt: 39,430 of 39,437 tokens, 1 s so far [strata] writing a tool call: execute_code: 150 of max 65536 tokens, 185.4 tok/s, 2 s [strata] done: 262 tokens in 3 s (177.3 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] writing a tool call: execute_code: 18 of max 65536 tokens, 234.9 tok/s, 1 s [strata] writing a tool call: execute_code: 233 of max 65536 tokens, 213.6 tok/s, 2 s [strata] done: 264 tokens in 2 s (214.8 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] writing a tool call: execute_code: 25 of max 65536 tokens, 211.7 tok/s, 1 s [strata] done: 111 tokens in 1 s (201.6 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] reading the prompt: 42,040 of 42,047 tokens, 1 s so far [strata] done: 162 tokens in 2 s (240.5 tok/s) (stop, cancel=False), expert cache 98.2% hit [strata] reading the prompt: 484 of 485 tokens, 1 s so far [strata] done: 4 tokens in 1 s (184.9 tok/s) (stop, cancel=False), expert cache 97.5% hit [strata] done: 4 tokens in 1 s (296.2 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] writing a tool call: execute_code: 61 of max 65536 tokens, 211.7 tok/s, 1 s [strata] done: 85 tokens in 1 s (217.5 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] reading the prompt: 42,911 of 42,912 tokens, 1 s so far [strata] writing a tool call: execute_code: 181 of max 65536 tokens, 180.6 tok/s, 2 s [strata] done: 239 tokens in 2 s (191.1 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] done: 4 tokens in 1 s (319.8 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] writing a tool call: execute_code: 42 of max 65536 tokens, 149.5 tok/s, 1 s [strata] done: 132 tokens in 1 s (190.0 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] done: 30 tokens in 1 s (219.1 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] reading the prompt: 51,759 of 58,249 tokens, 2 s so far [strata] reading the prompt: 58,242 of 58,249 tokens, 5 s so far [strata] writing a tool call: execute_code: 105 of max 65536 tokens, 243.9 tok/s, 6 s [strata] done: 110 tokens in 6 s (245.7 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] done: 4 tokens in 1 s (333.1 tok/s) (stop, cancel=False), expert cache 99.5% hit [strata] writing a tool call: execute_code: 39 of max 65536 tokens, 169.1 tok/s, 1 s [strata] writing a tool call: execute_code: 265 of max 65536 tokens, 212.9 tok/s, 2 s [strata] done: 387 tokens in 3 s (216.3 tok/s) (stop, cancel=False), expert cache 98.6% hit [strata] done: 4 tokens in 1 s (307.4 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] reading the prompt: 59,414 of 59,415 tokens, 1 s so far [strata] writing a tool call: execute_code: 238 of max 65536 tokens, 237.3 tok/s, 2 s [strata] done: 371 tokens in 3 s (238.6 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] done: 4 tokens in 0 s (296.1 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] reading the prompt: 60,227 of 60,228 tokens, 1 s so far [strata] writing a tool call: execute_code: 245 of max 65536 tokens, 245.9 tok/s, 2 s [strata] done: 339 tokens in 3 s (246.6 tok/s) (stop, cancel=False), expert cache 98.0% hit [strata] done: 4 tokens in 0 s (307.4 tok/s) (stop, cancel=False), expert cache 99.3% hit [strata] writing a tool call: execute_code: 79 of max 65536 tokens, 259.2 tok/s, 1 s [strata] writing a tool call: execute_code: 354 of max 65536 tokens, 268.4 tok/s, 2 s [strata] done: 363 tokens in 2 s (268.4 tok/s) (stop, cancel=False), expert cache 98.4% hit [strata] reading the prompt: 522 of 523 tokens, 1 s so far [strata] done: 4 tokens in 1 s (249.9 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] done: 4 tokens in 1 s (166.6 tok/s) (stop, cancel=False), expert cache 99.1% hit [strata] done: 4 tokens in 1 s (275.7 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] writing a tool call: execute_code: 50 of max 65536 tokens, 249.8 tok/s, 1 s [strata] writing a tool call: execute_code: 259 of max 65536 tokens, 215.3 tok/s, 2 s [strata] writing a tool call: execute_code: 464 of max 65536 tokens, 210.3 tok/s, 3 s [strata] done: 491 tokens in 3 s (211.6 tok/s) (stop, cancel=False), expert cache 98.8% hit [strata] reading the prompt: 522 of 523 tokens, 1 s so far [strata] done: 4 tokens in 1 s (181.7 tok/s) (stop, cancel=False), expert cache 99.2% hit [strata] writing a tool call: execute_code: 45 of max 65536 tokens, 266.4 tok/s, 1 s [strata] writing a tool call: execute_code: 226 of max 65536 tokens, 191.8 tok/s, 2 s [strata] writing a tool call: execute_code: 424 of max 65536 tokens, 194.0 tok/s, 3 s [strata] done: 508 tokens in 3 s (193.2 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] writing a tool call: execute_code: 8 of max 65536 tokens, 231.8 tok/s, 1 s [strata] done: 150 tokens in 2 s (221.2 tok/s) (stop, cancel=False), expert cache 99.1% hit [strata] writing a tool call: terminal: 70 of max 65536 tokens, 236.3 tok/s, 1 s [strata] done: 186 tokens in 1 s (243.1 tok/s) (stop, cancel=False), expert cache 98.6% hit [strata] reading the prompt: 749 of 756 tokens, 1 s so far [strata] done: 4 tokens in 1 s (235.2 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] reading the prompt: 63,995 of 64,002 tokens, 1 s so far [strata] writing a tool call: execute_code: 202 of max 65536 tokens, 231.3 tok/s, 2 s [strata] writing a tool call: execute_code: 401 of max 65536 tokens, 213.1 tok/s, 3 s [strata] done: 460 tokens in 3 s (217.9 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] writing a tool call: execute_code: 42 of max 65536 tokens, 240.4 tok/s, 1 s [strata] writing a tool call: execute_code: 294 of max 65536 tokens, 247.8 tok/s, 2 s [strata] done: 374 tokens in 2 s (245.2 tok/s) (stop, cancel=False), expert cache 98.6% hit [strata] reading the prompt: 1,723 of 1,730 tokens, 2 s so far [strata] answering: 74 of max 129334 tokens, 95.5 tok/s, 3 s [strata] answering: 214 of max 129334 tokens, 120.1 tok/s, 4 s [strata] answering: 399 of max 129334 tokens, 142.9 tok/s, 5 s [strata] done: 526 tokens in 6 s (146.8 tok/s) (stop, cancel=False), expert cache 95.9% hit [strata] reading the prompt: 8,192 of 27,042 tokens, 2 s so far [strata] reading the prompt: 15,997 of 27,042 tokens, 4 s so far [strata] reading the prompt: 24,189 of 27,042 tokens, 6 s so far [strata] reading the prompt: 27,035 of 27,042 tokens, 8 s so far [strata] writing a tool call: execute_code: 63 of max 65536 tokens, 133.7 tok/s, 9 s [strata] writing a tool call: execute_code: 230 of max 65536 tokens, 155.7 tok/s, 10 s [strata] writing a tool call: execute_code: 429 of max 65536 tokens, 172.0 tok/s, 11 s [strata] done: 477 tokens in 12 s (176.5 tok/s) (stop, cancel=False), expert cache 94.9% hit [strata] reading the prompt: 521 of 522 tokens, 1 s so far [strata] done: 4 tokens in 1 s (242.2 tok/s) (stop, cancel=False), expert cache 93.6% hit [strata] answering: 2 of max 130542 tokens, 33.8 tok/s, 1 s [strata] done: 4 tokens in 1 s (67.7 tok/s) (stop, cancel=False), expert cache 96.9% hit [strata] answering: 1 of max 130542 tokens, 1000000.0 tok/s, 1 s [strata] done: 4 tokens in 1 s (257.9 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] reading the prompt: 2 of max 65536 tokens, 36.3 tok/s, 1 s [strata] done: 58 tokens in 1 s (138.7 tok/s) (stop, cancel=False), expert cache 96.8% hit [strata] reading the prompt: 7 of max 65536 tokens, 138.2 tok/s, 1 s [strata] writing a tool call: execute_code: 235 of max 65536 tokens, 220.4 tok/s, 2 s [strata] writing a tool call: execute_code: 464 of max 65536 tokens, 224.4 tok/s, 3 s [strata] done: 477 tokens in 3 s (225.6 tok/s) (stop, cancel=False), expert cache 97.6% hit [strata] done: 4 tokens in 0 s (199.8 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] done: 4 tokens in 0 s (296.1 tok/s) (stop, cancel=False), expert cache 99.1% hit [strata] done: 4 tokens in 0 s (199.9 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] reading the prompt: 1 of max 65536 tokens, 1000000.0 tok/s, 1 s [strata] writing a tool call: execute_code: 215 of max 65536 tokens, 212.8 tok/s, 2 s [strata] writing a tool call: execute_code: 466 of max 65536 tokens, 231.5 tok/s, 3 s [strata] done: 477 tokens in 3 s (232.9 tok/s) (stop, cancel=False), expert cache 96.8% hit [strata] done: 4 tokens in 0 s (285.4 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] done: 4 tokens in 0 s (140.2 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] done: 4 tokens in 0 s (296.2 tok/s) (stop, cancel=False), expert cache 99.6% hit [strata] reading the prompt: 30,111 of 30,112 tokens, 1 s so far [strata] writing a tool call: execute_code: 247 of max 65536 tokens, 249.1 tok/s, 2 s [strata] done: 477 tokens in 3 s (257.1 tok/s) (stop, cancel=False), expert cache 96.9% hit [strata] done: 4 tokens in 0 s (285.5 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] done: 4 tokens in 0 s (140.2 tok/s) (stop, cancel=False), expert cache 98.6% hit [strata] done: 4 tokens in 0 s (296.2 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] reading the prompt: 30,957 of 30,958 tokens, 1 s so far [strata] writing a tool call: execute_code: 259 of max 65536 tokens, 259.8 tok/s, 2 s [strata] done: 477 tokens in 3 s (268.2 tok/s) (stop, cancel=False), expert cache 97.2% hit [strata] done: 4 tokens in 0 s (135.5 tok/s) (stop, cancel=False), expert cache 98.4% hit [strata] done: 4 tokens in 0 s (275.7 tok/s) (stop, cancel=False), expert cache 99.1% hit [strata] done: 4 tokens in 0 s (216.0 tok/s) (stop, cancel=False), expert cache 99.3% hit [strata] reading the prompt: 31,803 of 31,804 tokens, 1 s so far [strata] writing a tool call: execute_code: 281 of max 65536 tokens, 280.1 tok/s, 2 s [strata] done: 477 tokens in 3 s (286.6 tok/s) (stop, cancel=False), expert cache 97.4% hit [strata] done: 4 tokens in 0 s (135.5 tok/s) (stop, cancel=False), expert cache 98.1% hit [strata] done: 4 tokens in 0 s (307.4 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] done: 4 tokens in 0 s (142.8 tok/s) (stop, cancel=False), expert cache 99.5% hit [strata] reading the prompt: 32,648 of 32,649 tokens, 1 s so far [strata] writing a tool call: execute_code: 281 of max 65536 tokens, 281.6 tok/s, 2 s [strata] done: 477 tokens in 3 s (285.9 tok/s) (stop, cancel=False), expert cache 97.5% hit [strata] done: 4 tokens in 0 s (266.4 tok/s) (stop, cancel=False), expert cache 97.7% hit [strata] done: 4 tokens in 0 s (115.9 tok/s) (stop, cancel=False), expert cache 98.0% hit [strata] done: 4 tokens in 0 s (307.5 tok/s) (stop, cancel=False), expert cache 99.5% hit [strata] reading the prompt: 33,493 of 33,494 tokens, 1 s so far [strata] writing a tool call: execute_code: 287 of max 65536 tokens, 284.5 tok/s, 2 s [strata] done: 477 tokens in 3 s (290.4 tok/s) (stop, cancel=False), expert cache 97.6% hit [strata] done: 4 tokens in 0 s (319.8 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] done: 4 tokens in 0 s (127.5 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] done: 4 tokens in 0 s (285.4 tok/s) (stop, cancel=False), expert cache 99.2% hit [strata] reading the prompt: 1 of max 65536 tokens, 1000000.0 tok/s, 1 s [strata] writing a tool call: execute_code: 284 of max 65536 tokens, 281.3 tok/s, 2 s [strata] done: 477 tokens in 3 s (281.2 tok/s) (stop, cancel=False), expert cache 97.5% hit [strata] done: 4 tokens in 0 s (275.6 tok/s) (stop, cancel=False), expert cache 97.4% hit [strata] done: 4 tokens in 0 s (105.2 tok/s) (stop, cancel=False), expert cache 97.4% hit [strata] done: 4 tokens in 0 s (285.4 tok/s) (stop, cancel=False), expert cache 99.6% hit [strata] reading the prompt: 35,185 of 35,186 tokens, 1 s so far [strata] writing a tool call: execute_code: 281 of max 65536 tokens, 282.8 tok/s, 2 s [strata] done: 477 tokens in 3 s (287.2 tok/s) (stop, cancel=False), expert cache 97.6% hit [strata] done: 4 tokens in 0 s (296.1 tok/s) (stop, cancel=False), expert cache 97.7% hit [strata] done: 4 tokens in 0 s (126.9 tok/s) (stop, cancel=False), expert cache 99.2% hit [strata] done: 4 tokens in 0 s (275.7 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] reading the prompt: 36,031 of 36,032 tokens, 1 s so far [strata] writing a tool call: execute_code: 287 of max 65536 tokens, 285.1 tok/s, 2 s [strata] done: 477 tokens in 3 s (289.8 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] done: 4 tokens in 0 s (142.8 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] done: 4 tokens in 0 s (285.3 tok/s) (stop, cancel=False), expert cache 99.3% hit [strata] done: 4 tokens in 0 s (166.1 tok/s) (stop, cancel=False), expert cache 99.3% hit [strata] reading the prompt: 36,877 of 36,878 tokens, 1 s so far [strata] writing a tool call: execute_code: 277 of max 65536 tokens, 277.6 tok/s, 2 s [strata] done: 477 tokens in 3 s (285.8 tok/s) (stop, cancel=False), expert cache 97.7% hit [strata] done: 4 tokens in 0 s (135.5 tok/s) (stop, cancel=False), expert cache 97.6% hit [strata] done: 4 tokens in 0 s (296.2 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] done: 4 tokens in 0 s (132.7 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] reading the prompt: 37,723 of 37,724 tokens, 1 s so far [strata] writing a tool call: execute_code: 277 of max 65536 tokens, 276.3 tok/s, 2 s [strata] done: 477 tokens in 3 s (279.4 tok/s) (stop, cancel=False), expert cache 97.7% hit [strata] done: 4 tokens in 0 s (285.4 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] done: 4 tokens in 0 s (115.9 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] done: 4 tokens in 0 s (275.5 tok/s) (stop, cancel=False), expert cache 99.2% hit [strata] reading the prompt: 38,569 of 38,570 tokens, 1 s so far [strata] writing a tool call: execute_code: 281 of max 65536 tokens, 283.0 tok/s, 2 s [strata] done: 477 tokens in 3 s (293.2 tok/s) (stop, cancel=False), expert cache 97.9% hit [strata] done: 4 tokens in 0 s (145.3 tok/s) (stop, cancel=False), expert cache 96.6% hit [strata] done: 4 tokens in 0 s (319.8 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] done: 4 tokens in 0 s (173.8 tok/s) (stop, cancel=False), expert cache 99.3% hit [strata] reading the prompt: 39,415 of 39,416 tokens, 1 s so far [strata] writing a tool call: execute_code: 287 of max 65536 tokens, 288.8 tok/s, 2 s [strata] done: 477 tokens in 3 s (285.2 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] done: 4 tokens in 0 s (266.4 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] done: 4 tokens in 0 s (105.2 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] done: 4 tokens in 0 s (296.1 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] reading the prompt: 40,261 of 40,262 tokens, 1 s so far [strata] writing a tool call: execute_code: 277 of max 65536 tokens, 279.5 tok/s, 2 s [strata] done: 477 tokens in 3 s (281.9 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] done: 1 tokens in 0 s (997.5 tok/s) (length, cancel=False), expert cache 96.5% hit [strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer [strata] done: 4 tokens in 0 s (78.3 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] done: 4 tokens in 0 s (380.6 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] reading the prompt: 8,192 of 24,419 tokens, 2 s so far [strata] reading the prompt: 16,384 of 24,419 tokens, 4 s so far [strata] reading the prompt: 16,712 of 24,419 tokens, 5 s so far [strata] reading the prompt: 24,412 of 24,419 tokens, 8 s so far [strata] reading the prompt: 515 of 522 tokens, 9 s so far [strata] reading the prompt: 3 of max 106645 tokens, 1.9 tok/s, 10 s [strata] done: 4 tokens in 9 s (37.7 tok/s) (stop, cancel=False), expert cache 99.6% hit [strata] reading the prompt: 8,192 of 41,109 tokens, 2 s so far [strata] writing a tool call: terminal: 37 of max 106645 tokens, 8.5 tok/s, 12 s [strata] done: 73 tokens in 13 s (15.4 tok/s) (stop, cancel=False), expert cache 73.5% hit [strata] reading the prompt: 15,997 of 41,109 tokens, 5 s so far [strata] reading the prompt: 24,189 of 41,109 tokens, 7 s so far [strata] reading the prompt: 32,381 of 41,109 tokens, 9 s so far [strata] reading the prompt: 40,573 of 41,109 tokens, 11 s so far [strata] reading the prompt: 41,102 of 41,109 tokens, 12 s so far [strata] reading the prompt: 24,542 of 24,549 tokens, 8 s so far [strata] reading the prompt: 3 of max 65536 tokens, 3.3 tok/s, 14 s [strata] done: 58 tokens in 9 s (66.4 tok/s) (stop, cancel=False), expert cache 95.4% hit [strata] writing a tool call: execute_code: 63 of max 65536 tokens, 32.4 tok/s, 15 s [strata] reading the prompt: 24,809 of 24,816 tokens, 1 s so far [strata] writing a tool call: execute_code: 235 of max 65536 tokens, 58.6 tok/s, 17 s [strata] done: 55 tokens in 2 s (69.2 tok/s) (stop, cancel=False), expert cache 95.4% hit [strata] writing a tool call: execute_code: 305 of max 65536 tokens, 60.4 tok/s, 18 s [strata] writing a tool call: execute_code: 456 of max 65536 tokens, 67.8 tok/s, 20 s [strata] reading the prompt: 2 of max 106112 tokens, 13.9 tok/s, 1 s [strata] done: 477 tokens in 20 s (68.2 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] reading the prompt: 515 of 522 tokens, 1 s so far [strata] writing a tool call: terminal: 36 of max 106112 tokens, 16.4 tok/s, 3 s [strata] done: 4 tokens in 1 s (33.4 tok/s) (stop, cancel=False), expert cache 98.1% hit [strata] done: 51 tokens in 3 s (20.3 tok/s) (stop, cancel=False), expert cache 94.1% hit 已经升级到最新版。 发现多开本身没问题，但仅在短上下文的情况下可以。 如果长上下文就完蛋。 正常高速阶段 250–320 tok/s 推理速度较高 中间阶段 130–180 tok/s 速度有所下降 较慢阶段 60–75 tok/s 性能明显下降 更慢的阶段 15–35 tok/s 存在明显的性能异常 某次工具调用 8.5 tok/s 该阶段非常慢 如果各位大神能测试测试 长上下文 多开时的处理 应该才能真正看到瓶颈的存在。 我还是那句话，自己玩玩可以，进生产环境可能还不行。

loading the model (the first start takes a minute or two) ... [strata] starting the engine: reading the model's weights ... [strata] loading the experts the GPU does not hold into RAM (of about 38 GB) and locking part of them for the GPU. YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES NOW - this is normal. Please wait and don't close this window; the browser opens when it is ready. [strata] filling the GPU's expert cache (17148 experts, 22.08 GiB of VRAM) ... [strata] still starting (24 s) - please wait ... [strata] almost ready ... ready: http://192.168.0.3:8080/v1 (OpenAI: /v1/chat/completions, Anthropic: /v1/messages, context 131072 tokens) open http://192.168.0.3:8080/ in a browser to chat; close this window to stop the model from other devices: http://192.168.0.3:8080/ (API: http://192.168.0.3:8080/v1) from other devices: http://172.23.128.1:8080/ (API: http://172.23.128.1:8080/v1) WARNING: no API key - anyone on your network can use this model. Add "api_key": "..." to the config (clients send it as their API key; the web page asks for it) nothing arrives? Windows Firewall blocks it until allowed: accept its prompt for Python, or run in an admin PowerShell: New-NetFirewallRule -DisplayName "Strata 8080" -Direction Inbound -Protocol TCP -LocalPort 8080 -Action Allow -Profile Private (and set this network to Private in Windows' network settings) [strata] reading the prompt: 8,192 of 27,533 tokens, 2 s so far [strata] reading the prompt: 16,384 of 27,533 tokens, 5 s so far [strata] reading the prompt: 24,904 of 27,533 tokens, 8 s so far [strata] reading the prompt: 27,526 of 27,533 tokens, 10 s so far [strata] writing a tool call: terminal: 44 of max 103531 tokens, 113.9 tok/s, 11 s [strata] done: 131 tokens in 12 s (117.8 tok/s) (stop, cancel=False), expert cache 85.4% hit [strata] reading the prompt: 8,192 of 17,916 tokens, 2 s so far [strata] reading the prompt: 16,003 of 17,916 tokens, 5 s so far [strata] reading the prompt: 17,909 of 17,916 tokens, 6 s so far [strata] reading the prompt: 27,960 of 27,967 tokens, 3 s so far [strata] reading the prompt: 4 of max 65536 tokens, 2.6 tok/s, 9 s [strata] writing a tool call: terminal: 52 of max 103097 tokens, 60.5 tok/s, 4 s [strata] writing a tool call: execute_code: 79 of max 65536 tokens, 30.8 tok/s, 10 s [strata] writing a tool call: terminal: 126 of max 103097 tokens, 67.4 tok/s, 5 s [strata] writing a tool call: execute_code: 153 of max 65536 tokens, 42.8 tok/s, 11 s [strata] done: 159 tokens in 5 s (68.2 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] done: 171 tokens in 11 s (42.5 tok/s) (stop, cancel=False), expert cache 88.2% hit [strata] done: 4 tokens in 1 s (70.1 tok/s) (stop, cancel=False), expert cache 94.9% hit [strata] reading the prompt: 19,121 of 19,128 tokens, 2 s so far [strata] writing a tool call: execute_code: 105 of max 65536 tokens, 128.7 tok/s, 3 s [strata] done: 185 tokens in 3 s (150.5 tok/s) (stop, cancel=False), expert cache 96.6% hit [strata] reading the prompt: 27,504 of 32,319 tokens, 2 s so far [strata] reading the prompt: 32,312 of 32,319 tokens, 4 s so far [strata] reading the prompt: 28,256 of 28,263 tokens, 5 s so far [strata] reading the prompt: 4 of max 65536 tokens, 2.9 tok/s, 6 s [strata] writing a tool call: terminal: 59 of max 102801 tokens, 67.2 tok/s, 6 s [strata] done: 79 tokens in 6 s (69.7 tok/s) (stop, cancel=False), expert cache 95.8% hit [strata] writing a tool call: execute_code: 85 of max 65536 tokens, 32.1 tok/s, 7 s [strata] writing a tool call: search_files: 205 of max 65536 tokens, 48.9 tok/s, 9 s [strata] answering: 20 of max 102682 tokens, 49.5 tok/s, 1 s [strata] done: 223 tokens in 9 s (50.4 tok/s) (stop, cancel=False), expert cache 97.9% hit [strata] reading the prompt: 485 of 486 tokens, 1 s so far [strata] answering: 34 of max 102682 tokens, 17.6 tok/s, 3 s [strata] done: 4 tokens in 1 s (35.3 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] reading the prompt: 475 of 476 tokens, 1 s so far [strata] answering: 80 of max 102682 tokens, 22.4 tok/s, 4 s [strata] done: 4 tokens in 1 s (35.6 tok/s) (stop, cancel=False), expert cache 99.2% hit [strata] answering: 124 of max 102682 tokens, 25.1 tok/s, 6 s [strata] done: 4 tokens in 1 s (28.7 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] done: 176 tokens in 6 s (32.6 tok/s) (stop, cancel=False), expert cache 97.1% hit [strata] response_format json_schema: the Python package jsonschema is not installed, so answers are only checked to be one JSON object (python -m pip install "jsonschema>=4.23,<5") [strata] reading the prompt: 844 of 851 tokens, 1 s so far [strata] reading the prompt: 8,192 of 33,834 tokens, 3 s so far [strata] answering: 4 of max 130213 tokens, 1.8 tok/s, 3 s [strata] done: 11 tokens in 4 s (4.8 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] reading the prompt: 16,003 of 33,834 tokens, 6 s so far [strata] reading the prompt: 24,195 of 33,834 tokens, 8 s so far [strata] reading the prompt: 32,387 of 33,834 tokens, 10 s so far [strata] reading the prompt: 33,827 of 33,834 tokens, 12 s so far [strata] reading the prompt: 5 of max 65536 tokens, 8.0 tok/s, 13 s [strata] done: 140 tokens in 14 s (99.5 tok/s) (stop, cancel=False), expert cache 98.7% hit [strata] reading the prompt: 35,836 of 35,843 tokens, 2 s so far [strata] done: 55 tokens in 2 s (193.1 tok/s) (stop, cancel=False), expert cache 98.1% hit [strata] reading the prompt: 38,324 of 38,331 tokens, 2 s so far [strata] writing a tool call: execute_code: 132 of max 65536 tokens, 181.1 tok/s, 3 s [strata] done: 193 tokens in 3 s (180.8 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] reading the prompt: 39,430 of 39,437 tokens, 1 s so far [strata] writing a tool call: execute_code: 150 of max 65536 tokens, 185.4 tok/s, 2 s [strata] done: 262 tokens in 3 s (177.3 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] writing a tool call: execute_code: 18 of max 65536 tokens, 234.9 tok/s, 1 s [strata] writing a tool call: execute_code: 233 of max 65536 tokens, 213.6 tok/s, 2 s [strata] done: 264 tokens in 2 s (214.8 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] writing a tool call: execute_code: 25 of max 65536 tokens, 211.7 tok/s, 1 s [strata] done: 111 tokens in 1 s (201.6 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] reading the prompt: 42,040 of 42,047 tokens, 1 s so far [strata] done: 162 tokens in 2 s (240.5 tok/s) (stop, cancel=False), expert cache 98.2% hit [strata] reading the prompt: 484 of 485 tokens, 1 s so far [strata] done: 4 tokens in 1 s (184.9 tok/s) (stop, cancel=False), expert cache 97.5% hit [strata] done: 4 tokens in 1 s (296.2 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] writing a tool call: execute_code: 61 of max 65536 tokens, 211.7 tok/s, 1 s [strata] done: 85 tokens in 1 s (217.5 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] reading the prompt: 42,911 of 42,912 tokens, 1 s so far [strata] writing a tool call: execute_code: 181 of max 65536 tokens, 180.6 tok/s, 2 s [strata] done: 239 tokens in 2 s (191.1 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] done: 4 tokens in 1 s (319.8 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] writing a tool call: execute_code: 42 of max 65536 tokens, 149.5 tok/s, 1 s [strata] done: 132 tokens in 1 s (190.0 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] done: 30 tokens in 1 s (219.1 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] reading the prompt: 51,759 of 58,249 tokens, 2 s so far [strata] reading the prompt: 58,242 of 58,249 tokens, 5 s so far [strata] writing a tool call: execute_code: 105 of max 65536 tokens, 243.9 tok/s, 6 s [strata] done: 110 tokens in 6 s (245.7 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] done: 4 tokens in 1 s (333.1 tok/s) (stop, cancel=False), expert cache 99.5% hit [strata] writing a tool call: execute_code: 39 of max 65536 tokens, 169.1 tok/s, 1 s [strata] writing a tool call: execute_code: 265 of max 65536 tokens, 212.9 tok/s, 2 s [strata] done: 387 tokens in 3 s (216.3 tok/s) (stop, cancel=False), expert cache 98.6% hit [strata] done: 4 tokens in 1 s (307.4 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] reading the prompt: 59,414 of 59,415 tokens, 1 s so far [strata] writing a tool call: execute_code: 238 of max 65536 tokens, 237.3 tok/s, 2 s [strata] done: 371 tokens in 3 s (238.6 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] done: 4 tokens in 0 s (296.1 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] reading the prompt: 60,227 of 60,228 tokens, 1 s so far [strata] writing a tool call: execute_code: 245 of max 65536 tokens, 245.9 tok/s, 2 s [strata] done: 339 tokens in 3 s (246.6 tok/s) (stop, cancel=False), expert cache 98.0% hit [strata] done: 4 tokens in 0 s (307.4 tok/s) (stop, cancel=False), expert cache 99.3% hit [strata] writing a tool call: execute_code: 79 of max 65536 tokens, 259.2 tok/s, 1 s [strata] writing a tool call: execute_code: 354 of max 65536 tokens, 268.4 tok/s, 2 s [strata] done: 363 tokens in 2 s (268.4 tok/s) (stop, cancel=False), expert cache 98.4% hit [strata] reading the prompt: 522 of 523 tokens, 1 s so far [strata] done: 4 tokens in 1 s (249.9 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] done: 4 tokens in 1 s (166.6 tok/s) (stop, cancel=False), expert cache 99.1% hit [strata] done: 4 tokens in 1 s (275.7 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] writing a tool call: execute_code: 50 of max 65536 tokens, 249.8 tok/s, 1 s [strata] writing a tool call: execute_code: 259 of max 65536 tokens, 215.3 tok/s, 2 s [strata] writing a tool call: execute_code: 464 of max 65536 tokens, 210.3 tok/s, 3 s [strata] done: 491 tokens in 3 s (211.6 tok/s) (stop, cancel=False), expert cache 98.8% hit [strata] reading the prompt: 522 of 523 tokens, 1 s so far [strata] done: 4 tokens in 1 s (181.7 tok/s) (stop, cancel=False), expert cache 99.2% hit [strata] writing a tool call: execute_code: 45 of max 65536 tokens, 266.4 tok/s, 1 s [strata] writing a tool call: execute_code: 226 of max 65536 tokens, 191.8 tok/s, 2 s [strata] writing a tool call: execute_code: 424 of max 65536 tokens, 194.0 tok/s, 3 s [strata] done: 508 tokens in 3 s (193.2 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] writing a tool call: execute_code: 8 of max 65536 tokens, 231.8 tok/s, 1 s [strata] done: 150 tokens in 2 s (221.2 tok/s) (stop, cancel=False), expert cache 99.1% hit [strata] writing a tool call: terminal: 70 of max 65536 tokens, 236.3 tok/s, 1 s [strata] done: 186 tokens in 1 s (243.1 tok/s) (stop, cancel=False), expert cache 98.6% hit [strata] reading the prompt: 749 of 756 tokens, 1 s so far [strata] done: 4 tokens in 1 s (235.2 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] reading the prompt: 63,995 of 64,002 tokens, 1 s so far [strata] writing a tool call: execute_code: 202 of max 65536 tokens, 231.3 tok/s, 2 s [strata] writing a tool call: execute_code: 401 of max 65536 tokens, 213.1 tok/s, 3 s [strata] done: 460 tokens in 3 s (217.9 tok/s) (stop, cancel=False), expert cache 98.9% hit [strata] writing a tool call: execute_code: 42 of max 65536 tokens, 240.4 tok/s, 1 s [strata] writing a tool call: execute_code: 294 of max 65536 tokens, 247.8 tok/s, 2 s [strata] done: 374 tokens in 2 s (245.2 tok/s) (stop, cancel=False), expert cache 98.6% hit [strata] reading the prompt: 1,723 of 1,730 tokens, 2 s so far [strata] answering: 74 of max 129334 tokens, 95.5 tok/s, 3 s [strata] answering: 214 of max 129334 tokens, 120.1 tok/s, 4 s [strata] answering: 399 of max 129334 tokens, 142.9 tok/s, 5 s [strata] done: 526 tokens in 6 s (146.8 tok/s) (stop, cancel=False), expert cache 95.9% hit [strata] reading the prompt: 8,192 of 27,042 tokens, 2 s so far [strata] reading the prompt: 15,997 of 27,042 tokens, 4 s so far [strata] reading the prompt: 24,189 of 27,042 tokens, 6 s so far [strata] reading the prompt: 27,035 of 27,042 tokens, 8 s so far [strata] writing a tool call: execute_code: 63 of max 65536 tokens, 133.7 tok/s, 9 s [strata] writing a tool call: execute_code: 230 of max 65536 tokens, 155.7 tok/s, 10 s [strata] writing a tool call: execute_code: 429 of max 65536 tokens, 172.0 tok/s, 11 s [strata] done: 477 tokens in 12 s (176.5 tok/s) (stop, cancel=False), expert cache 94.9% hit [strata] reading the prompt: 521 of 522 tokens, 1 s so far [strata] done: 4 tokens in 1 s (242.2 tok/s) (stop, cancel=False), expert cache 93.6% hit [strata] answering: 2 of max 130542 tokens, 33.8 tok/s, 1 s [strata] done: 4 tokens in 1 s (67.7 tok/s) (stop, cancel=False), expert cache 96.9% hit [strata] answering: 1 of max 130542 tokens, 1000000.0 tok/s, 1 s [strata] done: 4 tokens in 1 s (257.9 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] reading the prompt: 2 of max 65536 tokens, 36.3 tok/s, 1 s [strata] done: 58 tokens in 1 s (138.7 tok/s) (stop, cancel=False), expert cache 96.8% hit [strata] reading the prompt: 7 of max 65536 tokens, 138.2 tok/s, 1 s [strata] writing a tool call: execute_code: 235 of max 65536 tokens, 220.4 tok/s, 2 s [strata] writing a tool call: execute_code: 464 of max 65536 tokens, 224.4 tok/s, 3 s [strata] done: 477 tokens in 3 s (225.6 tok/s) (stop, cancel=False), expert cache 97.6% hit [strata] done: 4 tokens in 0 s (199.8 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] done: 4 tokens in 0 s (296.1 tok/s) (stop, cancel=False), expert cache 99.1% hit [strata] done: 4 tokens in 0 s (199.9 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] reading the prompt: 1 of max 65536 tokens, 1000000.0 tok/s, 1 s [strata] writing a tool call: execute_code: 215 of max 65536 tokens, 212.8 tok/s, 2 s [strata] writing a tool call: execute_code: 466 of max 65536 tokens, 231.5 tok/s, 3 s [strata] done: 477 tokens in 3 s (232.9 tok/s) (stop, cancel=False), expert cache 96.8% hit [strata] done: 4 tokens in 0 s (285.4 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] done: 4 tokens in 0 s (140.2 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] done: 4 tokens in 0 s (296.2 tok/s) (stop, cancel=False), expert cache 99.6% hit [strata] reading the prompt: 30,111 of 30,112 tokens, 1 s so far [strata] writing a tool call: execute_code: 247 of max 65536 tokens, 249.1 tok/s, 2 s [strata] done: 477 tokens in 3 s (257.1 tok/s) (stop, cancel=False), expert cache 96.9% hit [strata] done: 4 tokens in 0 s (285.5 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] done: 4 tokens in 0 s (140.2 tok/s) (stop, cancel=False), expert cache 98.6% hit [strata] done: 4 tokens in 0 s (296.2 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] reading the prompt: 30,957 of 30,958 tokens, 1 s so far [strata] writing a tool call: execute_code: 259 of max 65536 tokens, 259.8 tok/s, 2 s [strata] done: 477 tokens in 3 s (268.2 tok/s) (stop, cancel=False), expert cache 97.2% hit [strata] done: 4 tokens in 0 s (135.5 tok/s) (stop, cancel=False), expert cache 98.4% hit [strata] done: 4 tokens in 0 s (275.7 tok/s) (stop, cancel=False), expert cache 99.1% hit [strata] done: 4 tokens in 0 s (216.0 tok/s) (stop, cancel=False), expert cache 99.3% hit [strata] reading the prompt: 31,803 of 31,804 tokens, 1 s so far [strata] writing a tool call: execute_code: 281 of max 65536 tokens, 280.1 tok/s, 2 s [strata] done: 477 tokens in 3 s (286.6 tok/s) (stop, cancel=False), expert cache 97.4% hit [strata] done: 4 tokens in 0 s (135.5 tok/s) (stop, cancel=False), expert cache 98.1% hit [strata] done: 4 tokens in 0 s (307.4 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] done: 4 tokens in 0 s (142.8 tok/s) (stop, cancel=False), expert cache 99.5% hit [strata] reading the prompt: 32,648 of 32,649 tokens, 1 s so far [strata] writing a tool call: execute_code: 281 of max 65536 tokens, 281.6 tok/s, 2 s [strata] done: 477 tokens in 3 s (285.9 tok/s) (stop, cancel=False), expert cache 97.5% hit [strata] done: 4 tokens in 0 s (266.4 tok/s) (stop, cancel=False), expert cache 97.7% hit [strata] done: 4 tokens in 0 s (115.9 tok/s) (stop, cancel=False), expert cache 98.0% hit [strata] done: 4 tokens in 0 s (307.5 tok/s) (stop, cancel=False), expert cache 99.5% hit [strata] reading the prompt: 33,493 of 33,494 tokens, 1 s so far [strata] writing a tool call: execute_code: 287 of max 65536 tokens, 284.5 tok/s, 2 s [strata] done: 477 tokens in 3 s (290.4 tok/s) (stop, cancel=False), expert cache 97.6% hit [strata] done: 4 tokens in 0 s (319.8 tok/s) (stop, cancel=False), expert cache 98.5% hit [strata] done: 4 tokens in 0 s (127.5 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] done: 4 tokens in 0 s (285.4 tok/s) (stop, cancel=False), expert cache 99.2% hit [strata] reading the prompt: 1 of max 65536 tokens, 1000000.0 tok/s, 1 s [strata] writing a tool call: execute_code: 284 of max 65536 tokens, 281.3 tok/s, 2 s [strata] done: 477 tokens in 3 s (281.2 tok/s) (stop, cancel=False), expert cache 97.5% hit [strata] done: 4 tokens in 0 s (275.6 tok/s) (stop, cancel=False), expert cache 97.4% hit [strata] done: 4 tokens in 0 s (105.2 tok/s) (stop, cancel=False), expert cache 97.4% hit [strata] done: 4 tokens in 0 s (285.4 tok/s) (stop, cancel=False), expert cache 99.6% hit [strata] reading the prompt: 35,185 of 35,186 tokens, 1 s so far [strata] writing a tool call: execute_code: 281 of max 65536 tokens, 282.8 tok/s, 2 s [strata] done: 477 tokens in 3 s (287.2 tok/s) (stop, cancel=False), expert cache 97.6% hit [strata] done: 4 tokens in 0 s (296.1 tok/s) (stop, cancel=False), expert cache 97.7% hit [strata] done: 4 tokens in 0 s (126.9 tok/s) (stop, cancel=False), expert cache 99.2% hit [strata] done: 4 tokens in 0 s (275.7 tok/s) (stop, cancel=False), expert cache 99.0% hit [strata] reading the prompt: 36,031 of 36,032 tokens, 1 s so far [strata] writing a tool call: execute_code: 287 of max 65536 tokens, 285.1 tok/s, 2 s [strata] done: 477 tokens in 3 s (289.8 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] done: 4 tokens in 0 s (142.8 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] done: 4 tokens in 0 s (285.3 tok/s) (stop, cancel=False), expert cache 99.3% hit [strata] done: 4 tokens in 0 s (166.1 tok/s) (stop, cancel=False), expert cache 99.3% hit [strata] reading the prompt: 36,877 of 36,878 tokens, 1 s so far [strata] writing a tool call: execute_code: 277 of max 65536 tokens, 277.6 tok/s, 2 s [strata] done: 477 tokens in 3 s (285.8 tok/s) (stop, cancel=False), expert cache 97.7% hit [strata] done: 4 tokens in 0 s (135.5 tok/s) (stop, cancel=False), expert cache 97.6% hit [strata] done: 4 tokens in 0 s (296.2 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] done: 4 tokens in 0 s (132.7 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] reading the prompt: 37,723 of 37,724 tokens, 1 s so far [strata] writing a tool call: execute_code: 277 of max 65536 tokens, 276.3 tok/s, 2 s [strata] done: 477 tokens in 3 s (279.4 tok/s) (stop, cancel=False), expert cache 97.7% hit [strata] done: 4 tokens in 0 s (285.4 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] done: 4 tokens in 0 s (115.9 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] done: 4 tokens in 0 s (275.5 tok/s) (stop, cancel=False), expert cache 99.2% hit [strata] reading the prompt: 38,569 of 38,570 tokens, 1 s so far [strata] writing a tool call: execute_code: 281 of max 65536 tokens, 283.0 tok/s, 2 s [strata] done: 477 tokens in 3 s (293.2 tok/s) (stop, cancel=False), expert cache 97.9% hit [strata] done: 4 tokens in 0 s (145.3 tok/s) (stop, cancel=False), expert cache 96.6% hit [strata] done: 4 tokens in 0 s (319.8 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] done: 4 tokens in 0 s (173.8 tok/s) (stop, cancel=False), expert cache 99.3% hit [strata] reading the prompt: 39,415 of 39,416 tokens, 1 s so far [strata] writing a tool call: execute_code: 287 of max 65536 tokens, 288.8 tok/s, 2 s [strata] done: 477 tokens in 3 s (285.2 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] done: 4 tokens in 0 s (266.4 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] done: 4 tokens in 0 s (105.2 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] done: 4 tokens in 0 s (296.1 tok/s) (stop, cancel=False), expert cache 99.4% hit [strata] reading the prompt: 40,261 of 40,262 tokens, 1 s so far [strata] writing a tool call: execute_code: 277 of max 65536 tokens, 279.5 tok/s, 2 s [strata] done: 477 tokens in 3 s (281.9 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] done: 1 tokens in 0 s (997.5 tok/s) (length, cancel=False), expert cache 96.5% hit [strata] the reply reached max tokens while still thinking, so it has no answer: a thinking budget (reasoning_budget_tokens, in the request or in strata-<model>.json for every request) leaves room to answer [strata] done: 4 tokens in 0 s (78.3 tok/s) (stop, cancel=False), expert cache 97.3% hit [strata] done: 4 tokens in 0 s (380.6 tok/s) (stop, cancel=False), expert cache 97.8% hit [strata] reading the prompt: 8,192 of 24,419 tokens, 2 s so far [strata] reading the prompt: 16,384 of 24,419 tokens, 4 s so far [strata] reading the prompt: 16,712 of 24,419 tokens, 5 s so far [strata] reading the prompt: 24,412 of 24,419 tokens, 8 s so far [strata] reading the prompt: 515 of 522 tokens, 9 s so far [strata] reading the prompt: 3 of max 106645 tokens, 1.9 tok/s, 10 s [strata] done: 4 tokens in 9 s (37.7 tok/s) (stop, cancel=False), expert cache 99.6% hit [strata] reading the prompt: 8,192 of 41,109 tokens, 2 s so far [strata] writing a tool call: terminal: 37 of max 106645 tokens, 8.5 tok/s, 12 s [strata] done: 73 tokens in 13 s (15.4 tok/s) (stop, cancel=False), expert cache 73.5% hit [strata] reading the prompt: 15,997 of 41,109 tokens, 5 s so far [strata] reading the prompt: 24,189 of 41,109 tokens, 7 s so far [strata] reading the prompt: 32,381 of 41,109 tokens, 9 s so far [strata] reading the prompt: 40,573 of 41,109 tokens, 11 s so far [strata] reading the prompt: 41,102 of 41,109 tokens, 12 s so far [strata] reading the prompt: 24,542 of 24,549 tokens, 8 s so far [strata] reading the prompt: 3 of max 65536 tokens, 3.3 tok/s, 14 s [strata] done: 58 tokens in 9 s (66.4 tok/s) (stop, cancel=False), expert cache 95.4% hit [strata] writing a tool call: execute_code: 63 of max 65536 tokens, 32.4 tok/s, 15 s [strata] reading the prompt: 24,809 of 24,816 tokens, 1 s so far [strata] writing a tool call: execute_code: 235 of max 65536 tokens, 58.6 tok/s, 17 s [strata] done: 55 tokens in 2 s (69.2 tok/s) (stop, cancel=False), expert cache 95.4% hit [strata] writing a tool call: execute_code: 305 of max 65536 tokens, 60.4 tok/s, 18 s [strata] writing a tool call: execute_code: 456 of max 65536 tokens, 67.8 tok/s, 20 s [strata] reading the prompt: 2 of max 106112 tokens, 13.9 tok/s, 1 s [strata] done: 477 tokens in 20 s (68.2 tok/s) (stop, cancel=False), expert cache 98.3% hit [strata] reading the prompt: 515 of 522 tokens, 1 s so far [strata] writing a tool call: terminal: 36 of max 106112 tokens, 16.4 tok/s, 3 s [strata] done: 4 tokens in 1 s (33.4 tok/s) (stop, cancel=False), expert cache 98.1% hit [strata] done: 51 tokens in 3 s (20.3 tok/s) (stop, cancel=False), expert cache 94.1% hit 已经升级到最新版。 发现多开本身没问题，但仅在短上下文的情况下可以。 如果长上下文就完蛋。 正常高速阶段 250–320 tok/s 推理速度较高 中间阶段 130–180 tok/s 速度有所下降 较慢阶段 60–75 tok/s 性能明显下降 更慢的阶段 15–35 tok/s 存在明显的性能异常 某次工具调用 8.5 tok/s 该阶段非常慢 如果各位大神能测试测试 长上下文 多开时的处理 应该才能真正看到瓶颈的存在。 我还是那句话，自己玩玩可以，进生产环境可能还不行。