<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[Qwen3.8-27B 测试Nvidia RTX 3090  llama.cpp MTP TurboQuant]]></title><description><![CDATA[<p dir="auto"><img src="https://upload.lcz.me/uploads/0a905978-fed5-4b5d-a461-e27686ffb38e.png" alt="222.png" class=" img-fluid img-markdown" /></p>
<h2>简单测试一下，供大家参考</h2>
<table class="table table-bordered table-striped">
<thead>
<tr>
<th style="text-align:left">配置项</th>
<th style="text-align:left">具体信息</th>
</tr>
</thead>
<tbody>
<tr>
<td style="text-align:left"><strong>硬件</strong></td>
<td style="text-align:left">NVIDIA GeForce RTX 3090 24GB</td>
</tr>
<tr>
<td style="text-align:left"><strong>推理框架</strong></td>
<td style="text-align:left">llama.cpp</td>
</tr>
<tr>
<td style="text-align:left"><strong>加速技术</strong></td>
<td style="text-align:left">MTP (Multi-Token Prediction)</td>
</tr>
<tr>
<td style="text-align:left"><strong>显存优化</strong></td>
<td style="text-align:left">TurboQuant</td>
</tr>
<tr>
<td style="text-align:left"><strong>模型文件</strong></td>
<td style="text-align:left">Qwen3.8-27B-Q3_K_M.gguf</td>
</tr>
</tbody>
</table>
<h2>启动脚本</h2>
<pre><code class="language-bash">./llama-cpp-turboquant-mtp/build/bin/llama-server \
  -m ./models/Qwen3.8-27B-Q3_K_M.gguf \
  --mmproj ./models/mmproj-BF16.gguf \
  -c 131072 \
  -n 512 \
  -t 12 \
  -ngl 99 \
  --parallel 1 \
  --cache-type-k turbo3 \
  --cache-type-v turbo3 \
  --flash-attn on \
  --mlock \
  --batch-size 512 \
  --ubatch-size 512 \
  --reasoning-budget 0 \
  --spec-type draft-mtp \
  --spec-draft-n-max 3 \
  --spec-draft-p-min 0.75 \
  --host 0.0.0.0 \
  --port 8080 \
  --log-disable
</code></pre>
<h2>贪吃蛇简单测速</h2>
<p dir="auto"><img src="https://upload.lcz.me/uploads/f4f80ac9-7113-4e4b-95c4-891332be8c0e.png" alt="PixPin_2026-08-16_05-36-34.png" class=" img-fluid img-markdown" /></p>
<h2>3D小球测试</h2>
<pre><code class="language-c">请制作一个网页 3D 小球物理实验，要求同时存在 10 个不同颜色的球，它们受到重力影响并发生碰撞，用户可以拖动球，右侧可以调整重力和弹性，并提供开始、暂停、重置按钮。
</code></pre>
<p dir="auto"><img src="https://upload.lcz.me/uploads/be1ebc62-ff59-4942-8785-970d6489d1d6.jpeg" alt="a79cfecf-6fa7-413b-8b5c-13cc9289b7ae-image.jpeg" class=" img-fluid img-markdown" /></p>
]]></description><link>https://lcz.me/topic/1139</link><generator>RSS for Node</generator><lastBuildDate>Wed, 23 Sep 2026 04:08:22 GMT</lastBuildDate><atom:link href="https://lcz.me/topic/1139.rss" rel="self" type="application/rss+xml"/><pubDate>Sat, 15 Aug 2026 22:01:29 GMT</pubDate><ttl>60</ttl><item><title><![CDATA[Reply to Qwen3.8-27B 测试Nvidia RTX 3090  llama.cpp MTP TurboQuant on Sun, 16 Aug 2026 19:11:01 GMT]]></title><description><![CDATA[<blockquote>
<p dir="auto"><a class="plugin-mentions-user plugin-mentions-a" href="/user/williamlouis" aria-label="Profile: williamlouis">@<bdi>williamlouis</bdi></a> <a href="/post/12387">说</a>:</p>
<p dir="auto">文中有地方显示错误，还是输入问题。<br />
Qwen3.6-27B-Q3_K_M.gguf 一直都是用的这个模型。</p>
</blockquote>
<p dir="auto">感谢指正，我启动服务器去看了下，还好模型没错，只是输入错误！</p>
]]></description><link>https://lcz.me/post/12433</link><guid isPermaLink="true">https://lcz.me/post/12433</guid><dc:creator><![CDATA[像素盒子]]></dc:creator><pubDate>Sun, 16 Aug 2026 19:11:01 GMT</pubDate></item><item><title><![CDATA[Reply to Qwen3.8-27B 测试Nvidia RTX 3090  llama.cpp MTP TurboQuant on Sun, 16 Aug 2026 19:10:39 GMT]]></title><description><![CDATA[<blockquote>
<p dir="auto"><a class="plugin-mentions-user plugin-mentions-a" href="/user/terry" aria-label="Profile: terry">@<bdi>terry</bdi></a> <a href="/post/12395">说</a>:</p>
<p dir="auto"><a class="plugin-mentions-user plugin-mentions-a" href="/user/williamlouis" aria-label="Profile: williamlouis">@<bdi>williamlouis</bdi></a> 我被打脸了<br />
<a class="plugin-mentions-user plugin-mentions-a" href="/user/%E5%83%8F%E7%B4%A0%E7%9B%92%E5%AD%90" aria-label="Profile: 像素盒子">@<bdi>像素盒子</bdi></a>  哥们你看下你的帖子，有要要修正的地方吗？</p>
</blockquote>
<p dir="auto">感谢指正，我启动服务器去看了下，还好模型没错，只是输入错误！</p>
]]></description><link>https://lcz.me/post/12432</link><guid isPermaLink="true">https://lcz.me/post/12432</guid><dc:creator><![CDATA[像素盒子]]></dc:creator><pubDate>Sun, 16 Aug 2026 19:10:39 GMT</pubDate></item><item><title><![CDATA[Reply to Qwen3.8-27B 测试Nvidia RTX 3090  llama.cpp MTP TurboQuant on Sun, 16 Aug 2026 13:35:39 GMT]]></title><description><![CDATA[<p dir="auto"><a class="plugin-mentions-user plugin-mentions-a" href="/user/williamlouis" aria-label="Profile: williamlouis">@<bdi>williamlouis</bdi></a> 我被打脸了<br />
<a class="plugin-mentions-user plugin-mentions-a" href="/user/%E5%83%8F%E7%B4%A0%E7%9B%92%E5%AD%90" aria-label="Profile: 像素盒子">@<bdi>像素盒子</bdi></a>  哥们你看下你的帖子，有要要修正的地方吗？</p>
]]></description><link>https://lcz.me/post/12395</link><guid isPermaLink="true">https://lcz.me/post/12395</guid><dc:creator><![CDATA[terry]]></dc:creator><pubDate>Sun, 16 Aug 2026 13:35:39 GMT</pubDate></item><item><title><![CDATA[Reply to Qwen3.8-27B 测试Nvidia RTX 3090  llama.cpp MTP TurboQuant on Sun, 16 Aug 2026 11:58:02 GMT]]></title><description><![CDATA[<p dir="auto">文中有地方显示错误，还是输入问题。<br />
Qwen3.6-27B-Q3_K_M.gguf 一直都是用的这个模型。</p>
]]></description><link>https://lcz.me/post/12387</link><guid isPermaLink="true">https://lcz.me/post/12387</guid><dc:creator><![CDATA[williamlouis]]></dc:creator><pubDate>Sun, 16 Aug 2026 11:58:02 GMT</pubDate></item><item><title><![CDATA[Reply to Qwen3.8-27B 测试Nvidia RTX 3090  llama.cpp MTP TurboQuant on Sun, 16 Aug 2026 11:55:29 GMT]]></title><description><![CDATA[<p dir="auto">非常高质量的帖子，简单明了，没一大堆废话，有工具，参数，提示词，效果图，置顶。</p>
]]></description><link>https://lcz.me/post/12386</link><guid isPermaLink="true">https://lcz.me/post/12386</guid><dc:creator><![CDATA[terry]]></dc:creator><pubDate>Sun, 16 Aug 2026 11:55:29 GMT</pubDate></item></channel></rss>