月之暗面开放权重系列，快照收录 41 家量化仓；数量不代表模型质量或运行兼容性。Moonshot's open-weight series, with 41 quantisation repos in the snapshot. Counts do not establish quality or runtime compatibility.
通用对话General chat
长上下文Long context
先说清楚：这个站的数据怎么来的First, where this site's data comes from
✅ 实测字段Measured fields
直接从 Hugging Face 公开 API 读取的客观数据：文件体积（字节）、上下文长度、架构、许可、下载量、更新时间。Objective data read straight from the Hugging Face public API: file sizes in bytes, context length, architecture, licence, downloads, last updated.
✅ 推导Derived
由采集字段按公开规则算出：每权重比特数（依 llama.cpp 命名标准）、档位归属、显存需求区间。推导规则在Computed from the collected fields by published rules: bits per weight (per the llama.cpp naming convention), tier assignment, VRAM requirement range. The rules are fully published inMETHODOLOGY.md 完整公开，任何人可复算。 — anyone can recompute them.
❌ 我们不说的What we do not claim
哪个量化质量更高、哪个更快、哪个模型更强——这些需要实测，本站不跑 benchmark，所以不装作知道。凡我们给出的主观判断，一律显式标注「我们的口径」。Which quantisation is higher quality, which is faster, which model is stronger — these need measurement. This site does not run benchmarks, so it does not pretend to know. Every subjective judgement we do offer is explicitly marked as our own reading.
本站This site does不下载、不托管任何模型权重文件not download or host any model weight files。所有数字都来自公开元数据，点击即可回到发布页核对。. Every figure comes from public metadata, and clicking it takes you back to the release page to verify.采集时间Collected: 2026-10-30（数据快照，非实时） (a snapshot, not live)
出品属地Origin国产domestic出品方为月之暗面（北京）。Made by Moonshot AI (Beijing).
国内下载Direct access国内可直连direct OKModelScope 官方镜像直连可达（2026-10-20 实测 200）；Hugging Face 直连不可达。Official ModelScope mirror reachable (measured 200); Hugging Face direct unreachable. · 国内镜像入口domestic mirror
备案状态CAC filing已备案Filed：Beijing-MoonShot-20231016公示名称listed as「Moonshot」 · 备案时间filed 2023-11-03 · 首批第 16 行（月之暗面科技）。Row 16 of the first batch (Moonshot AI).
备案信息以网信办《生成式人工智能服务已备案信息》公示名单为准（按批次滚动更新，本站只抄编号不解读）；「国内可直连」是本站探测环境中的可达性记录，不是厂商承诺。Filing status is quoted from the CAC public registry (updated batch by batch; this site copies the number and does not interpret it). "Direct access" is this site's own reachability measurement from a mainland network, not a vendor promise.
网信办《生成式人工智能服务已备案信息》滚动公告页（13 个批次附件 PDF，2026-10-20 全量下载检索）：CAC · filed generative-AI service information (rolling announcement page, 13 batch attachment PDFs, full download & search on 2026-10-20): https://www.cac.gov.cn/2024-04/02/c_1713729983803145.htm
⚠ Non-permissive licence — the release page is authoritative. This site does not interpret licence terms or give legal advice.
访问门槛Access
✅ 公开下载 无需申请✅ Public download no application needed
规模Scale
官网标注Vendor states
2780B 总参（MoE，激活数未公开）2780B total params (MoE, activation count not disclosed)
官方 API 申报Official API
—
本站实测反推This site, measured
—
权重精度构成Precision breakdown
—
架构Architecture
kimi-k3
上下文长度Context length
1,048,576 tokens
基座Base model
本仓即基座（不是微调版）this repo is the base model, not a fine-tune
任务类型Task type
—
输入模态Input modality
✓ 支持✓ Supported出处 ↗source ↗模型卡model card · 2026-10-28 模型卡：原生多模态，同一模型理解文本、图像与视频；带 Vision Encoder。Card: native multimodal — understands text, images, and video in one model; includes a vision encoder.
工具调用Tool calling
✓ 支持✓ Supported出处 ↗source ↗模型卡model card · 2026-10-28 模型卡：原生 agentic，编排终端工具；多轮工具调用需回传完整 assistant 消息（含 tool_calls）。Card: natively agentic, orchestrates terminal tools; multi-turn tool calls require passing back the full assistant message (including tool_calls).
定位Role
通用General
标签Tags
—
官方下载量Downloads
862k点赞likes 12k
发布日Released
—
最近更新Last updated
2026-09-02
发布页体积Release-page size
—
许可为 other，须读发布页原文。Licence is "other"; you must read the release page text before using it.
B该选哪个Which one to pick按你的显存倒推work backwards from your VRAM
下面按发布文件体积 × 1.15 做示意筛选。文件大小来自发布页列表，不是运行内存实测；15% 只是固定练习假设，不能代替随上下文、架构和并发变化的缓存预算。先筛候选，再用容量工具核对。An illustrative filter uses published file size × 1.15. Sizes come from release listings, not measured resident memory. The fixed 15% teaching assumption does not replace a context-, architecture- and concurrency-dependent cache budget. Filter candidates, then check capacity.
本成员最小发布文件已超过上面的 80 GB 示例容量。先核对可用容量、分配方式与运行器支持，不能从文件大小断言运行方式。The smallest published file exceeds the 80 GB example. Check available capacity, allocation and runtime support; file size does not establish an execution configuration.
此示意筛选没有候选No candidate under this illustrative filter（最小 540.4 GB） (smallest tier 540.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
12 GB 示例容量12 GB illustrative capacity
此示意筛选没有候选No candidate under this illustrative filter（最小 540.4 GB） (smallest tier 540.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
16 GB 示例容量16 GB illustrative capacity
此示意筛选没有候选No candidate under this illustrative filter（最小 540.4 GB） (smallest tier 540.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
24 GB 示例容量24 GB illustrative capacity
此示意筛选没有候选No candidate under this illustrative filter（最小 540.4 GB） (smallest tier 540.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
48 GB 示例容量48 GB illustrative capacity
此示意筛选没有候选No candidate under this illustrative filter（最小 540.4 GB） (smallest tier 540.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
80 GB 示例容量80 GB illustrative capacity
此示意筛选没有候选No candidate under this illustrative filter（最小 540.4 GB） (smallest tier 540.4 GB) 示例容量档；不是硬件型号推荐，需另算缓存与运行时。Illustrative capacity; not a hardware recommendation. Budget cache/runtime separately.
系统内存与多设备：单独核对System RAM and multiple devices: check separately
分层加载、CPU 卸载和多设备分配取决于运行器、模型与后端版本。合计容量不等于单进程可用显存；不能仅凭表格保证能运行或推断速度。Layer loading, CPU offload and multi-device allocation depend on runtime, model and backend version. Aggregate capacity is not process-available VRAM; this table establishes neither execution nor speed.
此示意筛选没有候选No candidate under this illustrative filter（最小 540.4 GB） (smallest tier 540.4 GB) 示例合计容量；不是单进程可用量，多卡/系统内存不能直接等同一块显存。Illustrative aggregate capacity, not process-available memory. Multiple devices/RAM are not one VRAM pool.
128 GB 合计容量示例128 GB aggregate-capacity example
此示意筛选没有候选No candidate under this illustrative filter（最小 540.4 GB） (smallest tier 540.4 GB) 示例合计容量；不是单进程可用量，多卡/系统内存不能直接等同一块显存。Illustrative aggregate capacity, not process-available memory. Multiple devices/RAM are not one VRAM pool.
256 GB 合计容量示例256 GB aggregate-capacity example
此示意筛选没有候选No candidate under this illustrative filter（最小 540.4 GB） (smallest tier 540.4 GB) 示例合计容量；不是单进程可用量，多卡/系统内存不能直接等同一块显存。Illustrative aggregate capacity, not process-available memory. Multiple devices/RAM are not one VRAM pool.
640 GB 合计容量示例640 GB aggregate-capacity example
IQ1_SIQ1_S（540 GB · 极限压缩Extreme compression）
更省：Smaller: TQ1_0TQ1_0 509 GB / Q1_0Q1_0 466 GB 示例合计容量；不是单进程可用量，多卡/系统内存不能直接等同一块显存。Illustrative aggregate capacity, not process-available memory. Multiple devices/RAM are not one VRAM pool.
本系列档位体积跨度 540 GB → 1561 GB。
Tier sizes in this series span 540 GB → 1561 GB.
跨度过大说明同一系列的量化选择空间很宽，这正是量化选型的主要收益所在。
展开：发布文件体积Expand: published file sizes（16 档tiers）
量化档Quant
最小体积Min size
每权重比特bpw
档位Tier
这档意味着什么What this tier means
该档文件数 / 体积跨度Files in tier / size range
最小体积来源
IQ1_SIQ1_S
540 GB
1.62 bpw
极限压缩Extreme compression
能装下就装，质量明显下降Fit it in at the cost of visibly lower quality
「每权重比特」是按 llama.cpp 公开命名标准从文件名推导的，同一档位在不同模型上的真实值会略有差异。这是Bits per weight is derived from the filename by llama.cpp’s published naming convention; the real value varies slightly between models at the same tier. This isB 级推导grade-B derived，不是实测值。 — not a measured value.
卡片左侧色条 = 推荐档位Colour bar on the left = recommended tier近似无损Near lossless保守Conservative平衡Balanced长上下文Long context极限压缩Extreme compression
「建议档」是本站按体积最小且落在平衡档的规则自动选出的，不是质量排名。官方量化排在最前；带 imatrix 标记的仓库带重要性矩阵数据。The recommended tier is picked by rule — smallest size that still lands in the balanced tier — not by a quality ranking. Official quantisations are listed first; repos marked imatrix ship an importance matrix.
D每个变体详解Every variant in detail七字段seven fields
每个变体按七个字段展开：它是什么 → 量化者做了什么 → 与同系列其他变体的区别 → 存在的意义 → 优势 → 为什么选它 → 已知取舍。最后一项是本站唯一会写主观判断的地方，且都标注了「我们的口径」。Each variant expands along seven fields: what it is → what the quantiser did → how it differs from other variants in this series → why it exists → strengths → why you would pick it → known trade-offs.The last field is the only place this site offers a subjective judgement, and every item is marked as our own reading.
量化者做了什么What the quantiser did带重要性矩阵（imatrix：Kimi-K3-GGUF/imatrix_unsloth.gguf），用激活数据统计各层重要性后再量化，通常比纯 RTN 稳Ships an importance matrix (imatrix: Kimi-K3-GGUF/imatrix_unsloth.gguf) — quantises after scoring each layer by activation statistics, usually steadier than plain RTN；声明架构 kimi-k3，需核对运行器版本支持Declares kimi-k3; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 moonshotai/Kimi-K3The release page traces this back to moonshotai/Kimi-K3；权重总字节 7411.8 GB（发布页 gguf.total 字段）Total weight bytes 7411.8 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 9 个量化来源（AtomicChat 5 档tiers、6block 1 档tiers、vcruz305 1 档tiers、qtum 1 档tiers 等）。The series has 9 other quantisation sources (AtomicChat 5 tiers, 6block 1 tiers, vcruz305 1 tiers, qtum 1 tiers, among others). 本仓 9 档，覆盖最全。 This repo has 9 tiers — the broadest coverage coverage in this series.
存在的意义Why it exists提供 UD-Q8_K_XL 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as UD-Q8_K_XL. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 元数据记录了 imatrix；质量仍需结合校准资料与任务评估Metadata records an imatrix; quality still requires calibration details and task evaluation · 规则候选为 UD-Q8_K_XL（1561 GB），不构成性能结论Rule-based candidate: UD-Q8_K_XL (1561 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 UD-Q8_K_XL（1561 GB，近似无损）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: UD-Q8_K_XL (1561 GB, Near lossless). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 全仓 6903 GB，硬盘紧张的话建议只下需要的 1~2 个档位6903 GB for the whole repo — if disk is tight, download only the one or two tiers you need · 许可是 other，必须自己读发布页原文再决定能不能用The licence is other — read the release page yourself before deciding whether you may use it
量化者做了什么What the quantiser did带重要性矩阵（imatrix：/data/imatrix_v2.dat），用激活数据统计各层重要性后再量化，通常比纯 RTN 稳Ships an importance matrix (imatrix: /data/imatrix_v2.dat) — quantises after scoring each layer by activation statistics, usually steadier than plain RTN；声明架构 kimi-k3，需核对运行器版本支持Declares kimi-k3; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 moonshotai/Kimi-K3The release page traces this back to moonshotai/Kimi-K3；权重总字节 6200.5 GB（发布页 gguf.total 字段）Total weight bytes 6200.5 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 9 个量化来源（unsloth 9 档tiers、6block 1 档tiers、vcruz305 1 档tiers、qtum 1 档tiers 等）。The series has 9 other quantisation sources (unsloth 9 tiers, 6block 1 tiers, vcruz305 1 tiers, qtum 1 tiers, among others). 本仓 5 档，覆盖中等。 This repo has 5 tiers — middling coverage in this series.
存在的意义Why it exists提供 Q8_0 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as Q8_0. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 元数据记录了 imatrix；质量仍需结合校准资料与任务评估Metadata records an imatrix; quality still requires calibration details and task evaluation · 规则候选为 Q8_0（2955 GB），不构成性能结论Rule-based candidate: Q8_0 (2955 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 Q8_0（2955 GB，近似无损）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: Q8_0 (2955 GB, Near lossless). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 全仓 5775 GB，硬盘紧张的话建议只下需要的 1~2 个档位5775 GB for the whole repo — if disk is tight, download only the one or two tiers you need · 许可是 other，必须自己读发布页原文再决定能不能用The licence is other — read the release page yourself before deciding whether you may use it
量化者做了什么What the quantiser did带重要性矩阵（imatrix：imatrix_k3.gguf），用激活数据统计各层重要性后再量化，通常比纯 RTN 稳Ships an importance matrix (imatrix: imatrix_k3.gguf) — quantises after scoring each layer by activation statistics, usually steadier than plain RTN；声明架构 kimi-k3，需核对运行器版本支持Declares kimi-k3; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 moonshotai/Kimi-K3The release page traces this back to moonshotai/Kimi-K3；权重总字节 1119.9 GB（发布页 gguf.total 字段）Total weight bytes 1119.9 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 9 个量化来源（unsloth 9 档tiers、AtomicChat 5 档tiers、vcruz305 1 档tiers、qtum 1 档tiers 等）。The series has 9 other quantisation sources (unsloth 9 tiers, AtomicChat 5 tiers, vcruz305 1 tiers, qtum 1 tiers, among others). 本仓 1 档，覆盖中等。 This repo has 1 tiers — middling coverage in this series.
存在的意义Why it exists提供 IQ1_S 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as IQ1_S. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 元数据记录了 imatrix；质量仍需结合校准资料与任务评估Metadata records an imatrix; quality still requires calibration details and task evaluation · 规则候选为 IQ1_S（580 GB），不构成性能结论Rule-based candidate: IQ1_S (580 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 IQ1_S（580 GB，极限压缩）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: IQ1_S (580 GB, Extreme compression). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 快照仅识别 1 个档位；不合预算时需再查其他发布源The snapshot identifies only 1 tiers; inspect other sources if none fits your budget · 全仓 1043 GB，硬盘紧张的话建议只下需要的 1~2 个档位1043 GB for the whole repo — if disk is tight, download only the one or two tiers you need · 许可是 other，必须自己读发布页原文再决定能不能用The licence is other — read the release page yourself before deciding whether you may use it
量化者做了什么What the quantiser did未提供重要性矩阵（imatrix），走的是纯权重量化路线No importance matrix (imatrix); this is pure weight quantisation；声明架构 kimi-k3，需核对运行器版本支持Declares kimi-k3; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 moonshotai/Kimi-K3The release page traces this back to moonshotai/Kimi-K3；权重总字节 650.5 GB（发布页 gguf.total 字段）Total weight bytes 650.5 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 9 个量化来源（unsloth 9 档tiers、AtomicChat 5 档tiers、6block 1 档tiers、qtum 1 档tiers 等）。The series has 9 other quantisation sources (unsloth 9 tiers, AtomicChat 5 tiers, 6block 1 tiers, qtum 1 tiers, among others). 本仓 1 档，覆盖中等。 This repo has 1 tiers — middling coverage in this series.
存在的意义Why it exists提供 UD-IQ1_S 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as UD-IQ1_S. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 规则候选为 UD-IQ1_S（330 GB），不构成性能结论Rule-based candidate: UD-IQ1_S (330 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 UD-IQ1_S（330 GB，极限压缩）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: UD-IQ1_S (330 GB, Extreme compression). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 快照仅识别 1 个档位；不合预算时需再查其他发布源The snapshot identifies only 1 tiers; inspect other sources if none fits your budget · 未记录 imatrix，需另查发布说明；该字段缺失不能单独判定质量No imatrix recorded; inspect release notes. This missing field alone does not determine quality · 全仓 606 GB，硬盘紧张的话建议只下需要的 1~2 个档位606 GB for the whole repo — if disk is tight, download only the one or two tiers you need · 许可是 other，必须自己读发布页原文再决定能不能用The licence is other — read the release page yourself before deciding whether you may use it
它是什么What it isqtum/Kimi-K3-GGUF ↗，提供 1 个 GGUF 量化档，合计 1043 GB。由 qtum 发布。qtum/Kimi-K3-GGUF ↗, providing 1 GGUF tiers totalling 1043 GB. Published by qtum.
量化者做了什么What the quantiser did带重要性矩阵（imatrix：imatrix_k3.gguf），用激活数据统计各层重要性后再量化，通常比纯 RTN 稳Ships an importance matrix (imatrix: imatrix_k3.gguf) — quantises after scoring each layer by activation statistics, usually steadier than plain RTN；声明架构 kimi-k3，需核对运行器版本支持Declares kimi-k3; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 moonshotai/Kimi-K3The release page traces this back to moonshotai/Kimi-K3；权重总字节 1119.9 GB（发布页 gguf.total 字段）Total weight bytes 1119.9 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 9 个量化来源（unsloth 9 档tiers、AtomicChat 5 档tiers、6block 1 档tiers、vcruz305 1 档tiers 等）。The series has 9 other quantisation sources (unsloth 9 tiers, AtomicChat 5 tiers, 6block 1 tiers, vcruz305 1 tiers, among others). 本仓 1 档，覆盖中等。 This repo has 1 tiers — middling coverage in this series.
存在的意义Why it exists提供 IQ1_S 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as IQ1_S. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 元数据记录了 imatrix；质量仍需结合校准资料与任务评估Metadata records an imatrix; quality still requires calibration details and task evaluation · 规则候选为 IQ1_S（580 GB），不构成性能结论Rule-based candidate: IQ1_S (580 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 IQ1_S（580 GB，极限压缩）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: IQ1_S (580 GB, Extreme compression). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 快照仅识别 1 个档位；不合预算时需再查其他发布源The snapshot identifies only 1 tiers; inspect other sources if none fits your budget · 全仓 1043 GB，硬盘紧张的话建议只下需要的 1~2 个档位1043 GB for the whole repo — if disk is tight, download only the one or two tiers you need · 许可是 other，必须自己读发布页原文再决定能不能用The licence is other — read the release page yourself before deciding whether you may use it
量化者做了什么What the quantiser did未提供重要性矩阵（imatrix），走的是纯权重量化路线No importance matrix (imatrix); this is pure weight quantisation；声明架构 kimi-k3，需核对运行器版本支持Declares kimi-k3; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 moonshotai/Kimi-K3The release page traces this back to moonshotai/Kimi-K3。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 9 个量化来源（unsloth 9 档tiers、AtomicChat 5 档tiers、6block 1 档tiers、vcruz305 1 档tiers 等）。The series has 9 other quantisation sources (unsloth 9 tiers, AtomicChat 5 tiers, 6block 1 tiers, vcruz305 1 tiers, among others). 本仓 0 档，覆盖最少。 This repo has 0 tiers — the narrowest coverage in this series.
存在的意义Why it exists提供 — 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as —. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 按文件体积与版本信息逐项核对；本站没有该版本的运行结果Check file size and version details; this site has no execution results for this build
为什么选它 / 目的Why you would pick it / its purpose该仓无可用档位。This repo has no usable tier.
已知取舍Known trade-offs· 快照仅识别 0 个档位；不合预算时需再查其他发布源The snapshot identifies only 0 tiers; inspect other sources if none fits your budget · 未记录 imatrix，需另查发布说明；该字段缺失不能单独判定质量No imatrix recorded; inspect release notes. This missing field alone does not determine quality · 许可是 other，必须自己读发布页原文再决定能不能用The licence is other — read the release page yourself before deciding whether you may use it
量化者做了什么What the quantiser did未提供重要性矩阵（imatrix），走的是纯权重量化路线No importance matrix (imatrix); this is pure weight quantisation；声明架构 kimi-k3，需核对运行器版本支持Declares kimi-k3; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 moonshotai/Kimi-K3The release page traces this back to moonshotai/Kimi-K3；权重总字节 928.6 GB（发布页 gguf.total 字段）Total weight bytes 928.6 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 9 个量化来源（unsloth 9 档tiers、AtomicChat 5 档tiers、6block 1 档tiers、vcruz305 1 档tiers 等）。The series has 9 other quantisation sources (unsloth 9 tiers, AtomicChat 5 tiers, 6block 1 tiers, vcruz305 1 tiers, among others). 本仓 1 档，覆盖中等。 This repo has 1 tiers — middling coverage in this series.
存在的意义Why it exists提供 Q2_K 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as Q2_K. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 规则候选为 Q2_K（929 GB），不构成性能结论Rule-based candidate: Q2_K (929 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 Q2_K（929 GB，极限压缩）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: Q2_K (929 GB, Extreme compression). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 快照仅识别 1 个档位；不合预算时需再查其他发布源The snapshot identifies only 1 tiers; inspect other sources if none fits your budget · 未记录 imatrix，需另查发布说明；该字段缺失不能单独判定质量No imatrix recorded; inspect release notes. This missing field alone does not determine quality · 全仓 865 GB，硬盘紧张的话建议只下需要的 1~2 个档位865 GB for the whole repo — if disk is tight, download only the one or two tiers you need · 许可是 other，必须自己读发布页原文再决定能不能用The licence is other — read the release page yourself before deciding whether you may use it
量化者做了什么What the quantiser did带重要性矩阵（imatrix：Kimi-K3-GGUF/imatrix_unsloth.gguf），用激活数据统计各层重要性后再量化，通常比纯 RTN 稳Ships an importance matrix (imatrix: Kimi-K3-GGUF/imatrix_unsloth.gguf) — quantises after scoring each layer by activation statistics, usually steadier than plain RTN；声明架构 kimi-k3，需核对运行器版本支持Declares kimi-k3; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 moonshotai/Kimi-K3The release page traces this back to moonshotai/Kimi-K3；权重总字节 5885.0 GB（发布页 gguf.total 字段）Total weight bytes 5885.0 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 9 个量化来源（unsloth 9 档tiers、AtomicChat 5 档tiers、6block 1 档tiers、vcruz305 1 档tiers 等）。The series has 9 other quantisation sources (unsloth 9 tiers, AtomicChat 5 tiers, 6block 1 tiers, vcruz305 1 tiers, among others). 本仓 6 档，覆盖中等。 This repo has 6 tiers — middling coverage in this series.
存在的意义Why it exists提供 UD-Q8_K_XL 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as UD-Q8_K_XL. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 元数据记录了 imatrix；质量仍需结合校准资料与任务评估Metadata records an imatrix; quality still requires calibration details and task evaluation · 规则候选为 UD-Q8_K_XL（1561 GB），不构成性能结论Rule-based candidate: UD-Q8_K_XL (1561 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 UD-Q8_K_XL（1561 GB，近似无损）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: UD-Q8_K_XL (1561 GB, Near lossless). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 全仓 5481 GB，硬盘紧张的话建议只下需要的 1~2 个档位5481 GB for the whole repo — if disk is tight, download only the one or two tiers you need · 许可是 other，必须自己读发布页原文再决定能不能用The licence is other — read the release page yourself before deciding whether you may use it
量化者做了什么What the quantiser did带重要性矩阵（imatrix：Kimi-K3-GGUF/imatrix_unsloth.gguf），用激活数据统计各层重要性后再量化，通常比纯 RTN 稳Ships an importance matrix (imatrix: Kimi-K3-GGUF/imatrix_unsloth.gguf) — quantises after scoring each layer by activation statistics, usually steadier than plain RTN；声明架构 kimi-k3，需核对运行器版本支持Declares kimi-k3; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 moonshotai/Kimi-K3The release page traces this back to moonshotai/Kimi-K3；权重总字节 5885.0 GB（发布页 gguf.total 字段）Total weight bytes 5885.0 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 9 个量化来源（unsloth 9 档tiers、AtomicChat 5 档tiers、6block 1 档tiers、vcruz305 1 档tiers 等）。The series has 9 other quantisation sources (unsloth 9 tiers, AtomicChat 5 tiers, 6block 1 tiers, vcruz305 1 tiers, among others). 本仓 6 档，覆盖中等。 This repo has 6 tiers — middling coverage in this series.
存在的意义Why it exists提供 UD-Q8_K_XL 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as UD-Q8_K_XL. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 元数据记录了 imatrix；质量仍需结合校准资料与任务评估Metadata records an imatrix; quality still requires calibration details and task evaluation · 规则候选为 UD-Q8_K_XL（1561 GB），不构成性能结论Rule-based candidate: UD-Q8_K_XL (1561 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 UD-Q8_K_XL（1561 GB，近似无损）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: UD-Q8_K_XL (1561 GB, Near lossless). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 全仓 5481 GB，硬盘紧张的话建议只下需要的 1~2 个档位5481 GB for the whole repo — if disk is tight, download only the one or two tiers you need · 许可是 other，必须自己读发布页原文再决定能不能用The licence is other — read the release page yourself before deciding whether you may use it
量化者做了什么What the quantiser did未提供重要性矩阵（imatrix），走的是纯权重量化路线No importance matrix (imatrix); this is pure weight quantisation；声明架构 kimi-k3，需核对运行器版本支持Declares kimi-k3; check support in your runtime version；声明上下文 1,048,576 tokensDeclared context 1,048,576 tokens；发布页声明溯源到 moonshotai/Kimi-K3The release page traces this back to moonshotai/Kimi-K3；权重总字节 1561.2 GB（发布页 gguf.total 字段）Total weight bytes 1561.2 GB (the release page's gguf.total field)。
与同系列其他变体的区别How it differs from other variants in this series同系列另有 9 个量化来源（unsloth 9 档tiers、AtomicChat 5 档tiers、6block 1 档tiers、vcruz305 1 档tiers 等）。The series has 9 other quantisation sources (unsloth 9 tiers, AtomicChat 5 tiers, 6block 1 tiers, vcruz305 1 tiers, among others). 本仓 1 档，覆盖中等。 This repo has 1 tiers — middling coverage in this series.
存在的意义Why it exists提供 MXFP4 等量化候选。请核对基座版本、量化说明、校验值与运行器支持；第三方身份本身不说明质量高低。Provides quantisation candidates such as MXFP4. Check base version, method, checksums and runtime support; third-party status alone does not determine quality.
优势Strengths· 规则候选为 MXFP4（1561 GB），不构成性能结论Rule-based candidate: MXFP4 (1561 GB), not a performance finding
为什么选它 / 目的Why you would pick it / its purpose文件体积候选为 MXFP4（1561 GB，平衡档）。先用容量预算核对缓存、并发与系统开销，再查发布说明中的版本兼容性。File-size candidate: MXFP4 (1561 GB, Balanced). Check cache, concurrency and system overhead with the capacity budget, then verify version compatibility in the release notes.
已知取舍Known trade-offs· 快照仅识别 1 个档位；不合预算时需再查其他发布源The snapshot identifies only 1 tiers; inspect other sources if none fits your budget · 未记录 imatrix，需另查发布说明；该字段缺失不能单独判定质量No imatrix recorded; inspect release notes. This missing field alone does not determine quality · 全仓 1454 GB，硬盘紧张的话建议只下需要的 1~2 个档位1454 GB for the whole repo — if disk is tight, download only the one or two tiers you need · 许可是 other，必须自己读发布页原文再决定能不能用The licence is other — read the release page yourself before deciding whether you may use it
E量化者档案Quantiser profiles选量化者意味着什么what choosing a quantiser means
量化者决定了这个包的档位覆盖、命名规范、是否带 imatrix、什么时候跟进新模型。这一区块说明「选这个量化者的量化意味着什么」。The quantiser decides this build's tier coverage, naming convention, whether it ships imatrix, and how fast it follows new models. This section spells out what choosing that quantiser means.
unsloth第三方量化发布者，具体覆盖与下载量见快照Third-party quantiser; see snapshot coverage and downloads
Position: The broadest quantisation coverage and the highest downloads among third-party quantisers.
What it is good at: publishes GGUF for almost every mainstream base model first, with the most complete tier range — from extreme compression to near lossless. Offers both static and dynamic (the UD- prefix) quantisation.
Why choose the unsloth build:
Broad coverage → the tier you want is usually there
Naming discipline → Q4_K_M means Q4_K_M, with no different name for the same tier
Ships an importance matrix (imatrix) → quality is steadier than plain RTN
The smoothest path to official tutorials and LM Studio / llama.cpp integration
Note: unsloth's dynamic quantisation (UD-Q4_K_XL and similar) is slightly larger and slightly slower at the same tier, in exchange for usually better quality. Whether that trade is worth it depends on whether your bottleneck is VRAM or speed — this is our reading, not a measurement.
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
<p class="muted">This publisher ships no description. What follows is the repo’s own metadata (size, licence, file size, last updated) — no editorialising from us.</p>
按更新时间倒序。更新频繁说明该量化者在跟进新版本；长期不更新则基础模型升版后可能不同步。Sorted by most recent update. Frequent updates mean the quantiser is tracking new releases; a long silence means it may have fallen behind the base model.
本站只负责「该下哪一档」。跑起来是另一件事 —— 下面这几个工具自己的文档里写明了支持本地模型（Ollama / vLLM / llama.cpp / LM Studio），点进去看具体怎么接。This site only answers which tier to download. Running it is a different problem — the tools below document local-model support in their own docs (Ollama / vLLM / llama.cpp / LM Studio). Follow the link to see how.
这些条目的本地模型支持情况由它们自己的官方文档佐证；本站不实测。Local-model support for each entry is evidenced by that project official documentation. This site runs no measurements.
关于数据与许可Data and licensing
本站数据全部来自All data here comes from theHugging Face公开 API，采集时间public API, collected2026-10-30，为快照数据。; this is a snapshot.
本站This site does不下载、不托管任何模型权重文件not download or host any model weight files，只提供发布页链接。许可字段原样引自发布页， — it only links to release pages. Licence fields are quoted verbatim from them,本站不解读许可条款、不构成法律意见this site does not interpret licence terms or give legal advice，一切以 and everything is governed by发布页原文the legal page为准。.
模型名称均为各自权利人的商标，此处仅作描述性使用。本站与上述厂商无隶属或合作关系。Model names are trademarks of their respective owners and are used here only descriptively. This site is not affiliated with or endorsed by any of the vendors above.