MIT 许可，量化生态活跃，antirez（Redis 作者、llama.cpp 生态参与者）维护量化版。MIT licensed with an active quantisation ecosystem — the quantisations are maintained by antirez (author of Redis, a participant in the llama.cpp ecosystem) himself.
通用对话General chat
MIT 许可MIT licence
推理Reasoning
先说清楚：这个站的数据怎么来的First, where this site's data comes from
✅ 实测字段Measured fields
直接从 Hugging Face 公开 API 读取的客观数据：文件体积（字节）、上下文长度、架构、许可、下载量、更新时间。Objective data read straight from the Hugging Face public API: file sizes in bytes, context length, architecture, licence, downloads, last updated.
✅ 推导Derived
由采集字段按公开规则算出：每权重比特数（依 llama.cpp 命名标准）、档位归属、显存需求区间。推导规则在Computed from the collected fields by published rules: bits per weight (per the llama.cpp naming convention), tier assignment, VRAM requirement range. The rules are fully published inMETHODOLOGY.md 完整公开，任何人可复算。 — anyone can recompute them.
❌ 我们不说的What we do not claim
哪个量化质量更高、哪个更快、哪个模型更强——这些需要实测，本站不跑 benchmark，所以不装作知道。凡我们给出的主观判断，一律显式标注「我们的口径」。Which quantisation is higher quality, which is faster, which model is stronger — these need measurement. This site does not run benchmarks, so it does not pretend to know. Every subjective judgement we do offer is explicitly marked as our own reading.
本站This site does不下载、不托管任何模型权重文件not download or host any model weight files。所有数字都来自公开元数据，点击即可回到发布页核对。. Every figure comes from public metadata, and clicking it takes you back to the release page to verify.采集时间Collected: 2026-10-30（数据快照，非实时） (a snapshot, not live)
出品属地Origin国产domestic出品方为深度求索（北京）。Made by DeepSeek (Beijing).
国内下载Direct access国内可直连direct OKModelScope 官方镜像直连可达（2026-10-20 实测 200）；Hugging Face 直连不可达。Official ModelScope mirror reachable without proxy (measured 200); Hugging Face direct unreachable. · 国内镜像入口domestic mirror
备案状态CAC filing已备案Filed：Beijing-DeepseekChat-202404280016公示名称listed as「求索对话DeepSeek Chat」 · 备案时间filed 2024-05-13 · 2024-08 批次附件第 152 行。Row 152 of the 2024-08 batch attachment.
备案信息以网信办《生成式人工智能服务已备案信息》公示名单为准（按批次滚动更新，本站只抄编号不解读）；「国内可直连」是本站探测环境中的可达性记录，不是厂商承诺。Filing status is quoted from the CAC public registry (updated batch by batch; this site copies the number and does not interpret it). "Direct access" is this site's own reachability measurement from a mainland network, not a vendor promise.
网信办《生成式人工智能服务已备案信息》滚动公告页（13 个批次附件 PDF，2026-10-20 全量下载检索）：CAC · filed generative-AI service information (rolling announcement page, 13 batch attachment PDFs, full download & search on 2026-10-20): https://www.cac.gov.cn/2024-04/02/c_1713729983803145.htm
MIT 许可，20 个第三方量化仓，antirez 一家 124 万下载（2026-10-30 复测）。MIT licensed, 20 third-party quantisation repos; antirez alone accounts for 1.24M downloads (re-measured 2026-10-30).
B该选哪个Which one to pick按你的显存倒推work backwards from your VRAM
下面按发布文件体积 × 1.15 做示意筛选。文件大小来自发布页列表，不是运行内存实测；15% 只是固定练习假设，不能代替随上下文、架构和并发变化的缓存预算。先筛候选，再用容量工具核对。An illustrative filter uses published file size × 1.15. Sizes come from release listings, not measured resident memory. The fixed 15% teaching assumption does not replace a context-, architecture- and concurrency-dependent cache budget. Filter candidates, then check capacity.
本成员最小发布文件已超过上面的 80 GB 示例容量。先核对可用容量、分配方式与运行器支持，不能从文件大小断言运行方式。The smallest published file exceeds the 80 GB example. Check available capacity, allocation and runtime support; file size does not establish an execution configuration.
此示意筛选没有候选No candidate under this illustrative filter（最小 371.4 GB） (smallest tier 371.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
12 GB 示例容量12 GB illustrative capacity
此示意筛选没有候选No candidate under this illustrative filter（最小 371.4 GB） (smallest tier 371.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
16 GB 示例容量16 GB illustrative capacity
此示意筛选没有候选No candidate under this illustrative filter（最小 371.4 GB） (smallest tier 371.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
24 GB 示例容量24 GB illustrative capacity
此示意筛选没有候选No candidate under this illustrative filter（最小 371.4 GB） (smallest tier 371.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
48 GB 示例容量48 GB illustrative capacity
此示意筛选没有候选No candidate under this illustrative filter（最小 371.4 GB） (smallest tier 371.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
80 GB 示例容量80 GB illustrative capacity
此示意筛选没有候选No candidate under this illustrative filter（最小 371.4 GB） (smallest tier 371.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
系统内存与多设备：单独核对System RAM and multiple devices: check separately
分层加载、CPU 卸载和多设备分配取决于运行器、模型与后端版本。合计容量不等于单进程可用显存；不能仅凭表格保证能运行或推断速度。Layer loading, CPU offload and multi-device allocation depend on runtime, model and backend version. Aggregate capacity is not process-available VRAM; this table establishes neither execution nor speed.
此示意筛选没有候选No candidate under this illustrative filter（最小 371.4 GB） (smallest tier 371.4 GB) 示例合计容量；不是单进程可用量，多卡/系统内存不能直接等同一块显存。Illustrative aggregate capacity, not process-available memory. Multiple devices/RAM are not one VRAM pool.
128 GB 合计容量示例128 GB aggregate-capacity example
此示意筛选没有候选No candidate under this illustrative filter（最小 371.4 GB） (smallest tier 371.4 GB) 示例合计容量；不是单进程可用量，多卡/系统内存不能直接等同一块显存。Illustrative aggregate capacity, not process-available memory. Multiple devices/RAM are not one VRAM pool.
256 GB 合计容量示例256 GB aggregate-capacity example
此示意筛选没有候选No candidate under this illustrative filter（最小 371.4 GB） (smallest tier 371.4 GB) 示例合计容量；不是单进程可用量，多卡/系统内存不能直接等同一块显存。Illustrative aggregate capacity, not process-available memory. Multiple devices/RAM are not one VRAM pool.
640 GB 合计容量示例640 GB aggregate-capacity example
Q8_0Q8_0（508 GB · 近似无损Near lossless）
更省：Smaller: Q4_K_MQ4_K_M 445 GB / IQ3_XSIQ3_XS 434 GB 示例合计容量；不是单进程可用量，多卡/系统内存不能直接等同一块显存。Illustrative aggregate capacity, not process-available memory. Multiple devices/RAM are not one VRAM pool.
本系列档位体积跨度 371 GB → 508 GB。
Tier sizes in this series span 371 GB → 508 GB.
跨度过大说明同一系列的量化选择空间很宽，这正是量化选型的主要收益所在。
展开：发布文件体积Expand: published file sizes（7 档tiers）
量化档Quant
最小体积Min size
每权重比特bpw
档位Tier
这档意味着什么What this tier means
该档文件数 / 体积跨度Files in tier / size range
最小体积来源
IQ2_XXSIQ2_XXS
371 GB
2.13 bpw
极限压缩Extreme compression
能装下就装，质量明显下降Fit it in at the cost of visibly lower quality
「每权重比特」是按 llama.cpp 公开命名标准从文件名推导的，同一档位在不同模型上的真实值会略有差异。这是Bits per weight is derived from the filename by llama.cpp’s published naming convention; the real value varies slightly between models at the same tier. This isB 级推导grade-B derived，不是实测值。 — not a measured value.
卡片左侧色条 = 推荐档位Colour bar on the left = recommended tier近似无损Near lossless保守Conservative平衡Balanced长上下文Long context极限压缩Extreme compression
「建议档」是本站按体积最小且落在平衡档的规则自动选出的，不是质量排名。官方量化排在最前；带 imatrix 标记的仓库带重要性矩阵数据。The recommended tier is picked by rule — smallest size that still lands in the balanced tier — not by a quality ranking. Official quantisations are listed first; repos marked imatrix ship an importance matrix.
D每个变体详解Every variant in detail七字段seven fields
每个变体按七个字段展开：它是什么 → 量化者做了什么 → 与同系列其他变体的区别 → 存在的意义 → 优势 → 为什么选它 → 已知取舍。最后一项是本站唯一会写主观判断的地方，且都标注了「我们的口径」。Each variant expands along seven fields: what it is → what the quantiser did → how it differs from other variants in this series → why it exists → strengths → why you would pick it → known trade-offs.The last field is the only place this site offers a subjective judgement, and every item is marked as our own reading.
量化者做了什么What the quantiser did未提供重要性矩阵（imatrix），走的是纯权重量化路线No importance matrix (imatrix); this is pure weight quantisation；声明架构 deepseek41，需核对运行器版本支持Declares deepseek41; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 deepseek-ai/DeepSeek-V4.1-FlashThe release page traces this back to deepseek-ai/DeepSeek-V4.1-Flash；权重总字节 1564.5 GB（发布页 gguf.total 字段）Total weight bytes 1564.5 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 4 个量化来源（smalinin 4 档tiers、mxxm-t 1 档tiers、Solstice-AI 3 档tiers、JigSawPT 1 档tiers）。The series has 4 other quantisation sources (smalinin 4 tiers, mxxm-t 1 tiers, Solstice-AI 3 tiers, JigSawPT 1 tiers). 本仓 4 档，覆盖最全。 This repo has 4 tiers — the broadest coverage coverage in this series.
存在的意义Why it exists提供 Q4_K_M 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as Q4_K_M. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 规则候选为 Q4_K_M（445 GB），不构成性能结论Rule-based candidate: Q4_K_M (445 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 Q4_K_M（445 GB，平衡档）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: Q4_K_M (445 GB, Balanced). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 未记录 imatrix，需另查发布说明；该字段缺失不能单独判定质量No imatrix recorded; inspect release notes. This missing field alone does not determine quality · 全仓 1457 GB，硬盘紧张的话建议只下需要的 1~2 个档位1457 GB for the whole repo — if disk is tight, download only the one or two tiers you need
量化者做了什么What the quantiser did带重要性矩阵（imatrix：/home/sergei/_my_deepseek41/calibration/results/imatrix-stage5-full/imatrix-dsv41-262144.gguf），用激活数据统计各层重要性后再量化，通常比纯 RTN 稳Ships an importance matrix (imatrix: /home/sergei/_my_deepseek41/calibration/results/imatrix-stage5-full/imatrix-dsv41-262144.gguf) — quantises after scoring each layer by activation statistics, usually steadier than plain RTN；声明架构 deepseek41，需核对运行器版本支持Declares deepseek41; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 deepseek-ai/DeepSeek-V4.1-FlashThe release page traces this back to deepseek-ai/DeepSeek-V4.1-Flash；权重总字节 2062.2 GB（发布页 gguf.total 字段）Total weight bytes 2062.2 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 4 个量化来源（vcruz305 4 档tiers、mxxm-t 1 档tiers、Solstice-AI 3 档tiers、JigSawPT 1 档tiers）。The series has 4 other quantisation sources (vcruz305 4 tiers, mxxm-t 1 tiers, Solstice-AI 3 tiers, JigSawPT 1 tiers). 本仓 4 档，覆盖最全。 This repo has 4 tiers — the broadest coverage coverage in this series.
存在的意义Why it exists提供 MXFP4 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as MXFP4. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 元数据记录了 imatrix；质量仍需结合校准资料与任务评估Metadata records an imatrix; quality still requires calibration details and task evaluation · 规则候选为 MXFP4（508 GB），不构成性能结论Rule-based candidate: MXFP4 (508 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 MXFP4（508 GB，平衡档）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: MXFP4 (508 GB, Balanced). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 全仓 2062 GB，硬盘紧张的话建议只下需要的 1~2 个档位2062 GB for the whole repo — if disk is tight, download only the one or two tiers you need
量化者做了什么What the quantiser did未提供重要性矩阵（imatrix），走的是纯权重量化路线No importance matrix (imatrix); this is pure weight quantisation；声明架构 deepseek41，需核对运行器版本支持Declares deepseek41; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 deepseek-ai/DeepSeek-V4.1-Flash-1017The release page traces this back to deepseek-ai/DeepSeek-V4.1-Flash-1017；权重总字节 403.5 GB（发布页 gguf.total 字段）Total weight bytes 403.5 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 4 个量化来源（vcruz305 4 档tiers、smalinin 4 档tiers、Solstice-AI 3 档tiers、JigSawPT 1 档tiers）。The series has 4 other quantisation sources (vcruz305 4 tiers, smalinin 4 tiers, Solstice-AI 3 tiers, JigSawPT 1 tiers). 本仓 1 档，覆盖最少。 This repo has 1 tiers — the narrowest coverage in this series.
存在的意义Why it exists提供 MXFP4 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as MXFP4. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 规则候选为 MXFP4（404 GB），不构成性能结论Rule-based candidate: MXFP4 (404 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 MXFP4（404 GB，平衡档）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: MXFP4 (404 GB, Balanced). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 快照仅识别 1 个档位；不合预算时需再查其他发布源The snapshot identifies only 1 tiers; inspect other sources if none fits your budget · 未记录 imatrix，需另查发布说明；该字段缺失不能单独判定质量No imatrix recorded; inspect release notes. This missing field alone does not determine quality · 全仓 404 GB，硬盘紧张的话建议只下需要的 1~2 个档位404 GB for the whole repo — if disk is tight, download only the one or two tiers you need
量化者做了什么What the quantiser did未提供重要性矩阵（imatrix），走的是纯权重量化路线No importance matrix (imatrix); this is pure weight quantisation；声明架构 deepseek41，需核对运行器版本支持Declares deepseek41; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 deepseek-ai/DeepSeek-V4.1-FlashThe release page traces this back to deepseek-ai/DeepSeek-V4.1-Flash；权重总字节 1300.0 GB（发布页 gguf.total 字段）Total weight bytes 1300.0 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 4 个量化来源（vcruz305 4 档tiers、smalinin 4 档tiers、mxxm-t 1 档tiers、JigSawPT 1 档tiers）。The series has 4 other quantisation sources (vcruz305 4 tiers, smalinin 4 tiers, mxxm-t 1 tiers, JigSawPT 1 tiers). 本仓 3 档，覆盖中等。 This repo has 3 tiers — middling coverage in this series.
存在的意义Why it exists提供 Q4_K_M 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as Q4_K_M. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 规则候选为 Q4_K_M（445 GB），不构成性能结论Rule-based candidate: Q4_K_M (445 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 Q4_K_M（445 GB，平衡档）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: Q4_K_M (445 GB, Balanced). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 快照仅识别 3 个档位；不合预算时需再查其他发布源The snapshot identifies only 3 tiers; inspect other sources if none fits your budget · 未记录 imatrix，需另查发布说明；该字段缺失不能单独判定质量No imatrix recorded; inspect release notes. This missing field alone does not determine quality · 全仓 1211 GB，硬盘紧张的话建议只下需要的 1~2 个档位1211 GB for the whole repo — if disk is tight, download only the one or two tiers you need
量化者做了什么What the quantiser did未提供重要性矩阵（imatrix），走的是纯权重量化路线No importance matrix (imatrix); this is pure weight quantisation；声明架构 deepseek41，需核对运行器版本支持Declares deepseek41; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 deepseek-ai/DeepSeek-V4.1-FlashThe release page traces this back to deepseek-ai/DeepSeek-V4.1-Flash；权重总字节 501.8 GB（发布页 gguf.total 字段）Total weight bytes 501.8 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 4 个量化来源（vcruz305 4 档tiers、smalinin 4 档tiers、mxxm-t 1 档tiers、Solstice-AI 3 档tiers）。The series has 4 other quantisation sources (vcruz305 4 tiers, smalinin 4 tiers, mxxm-t 1 tiers, Solstice-AI 3 tiers). 本仓 1 档，覆盖最少。 This repo has 1 tiers — the narrowest coverage in this series.
存在的意义Why it exists提供 MXFP4 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as MXFP4. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 规则候选为 MXFP4（502 GB），不构成性能结论Rule-based candidate: MXFP4 (502 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 MXFP4（502 GB，平衡档）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: MXFP4 (502 GB, Balanced). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 快照仅识别 1 个档位；不合预算时需再查其他发布源The snapshot identifies only 1 tiers; inspect other sources if none fits your budget · 未记录 imatrix，需另查发布说明；该字段缺失不能单独判定质量No imatrix recorded; inspect release notes. This missing field alone does not determine quality · 全仓 467 GB，硬盘紧张的话建议只下需要的 1~2 个档位467 GB for the whole repo — if disk is tight, download only the one or two tiers you need
E量化者档案Quantiser profiles选量化者意味着什么what choosing a quantiser means
量化者决定了这个包的档位覆盖、命名规范、是否带 imatrix、什么时候跟进新模型。这一区块说明「选这个量化者的量化意味着什么」。The quantiser decides this build's tier coverage, naming convention, whether it ships imatrix, and how fast it follows new models. This section spells out what choosing that quantiser means.
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
按更新时间倒序。更新频繁说明该量化者在跟进新版本；长期不更新则基础模型升版后可能不同步。Sorted by most recent update. Frequent updates mean the quantiser is tracking new releases; a long silence means it may have fallen behind the base model.
本站只负责「该下哪一档」。跑起来是另一件事 —— 下面这几个工具自己的文档里写明了支持本地模型（Ollama / vLLM / llama.cpp / LM Studio），点进去看具体怎么接。This site only answers which tier to download. Running it is a different problem — the tools below document local-model support in their own docs (Ollama / vLLM / llama.cpp / LM Studio). Follow the link to see how.
这些条目的本地模型支持情况由它们自己的官方文档佐证；本站不实测。Local-model support for each entry is evidenced by that project official documentation. This site runs no measurements.
关于数据与许可Data and licensing
本站数据全部来自All data here comes from theHugging Face公开 API，采集时间public API, collected2026-10-30，为快照数据。; this is a snapshot.
本站This site does不下载、不托管任何模型权重文件not download or host any model weight files，只提供发布页链接。许可字段原样引自发布页， — it only links to release pages. Licence fields are quoted verbatim from them,本站不解读许可条款、不构成法律意见this site does not interpret licence terms or give legal advice，一切以 and everything is governed by发布页原文the legal page为准。.
模型名称均为各自权利人的商标，此处仅作描述性使用。本站与上述厂商无隶属或合作关系。Model names are trademarks of their respective owners and are used here only descriptively. This site is not affiliated with or endorsed by any of the vendors above.