2.78万亿参数Kimi K3实现8GB内存运行，开发者开源轻量C推理引擎

2.78万亿参数Kimi K3实现8GB内存运行，开发者开源轻量C推理引擎

2026-08-08 14:25

ChainThink 消息，8 月 8 日，据开发者开源项目 kimi-k3-in-c 信息，有开发者尝试让 2.78 万亿参数的 Kimi K3 模型在仅 8GB 内存设备上运行。

该项目体积约 176KB，采用纯 C99 编写，不依赖 GPU、CUDA、PyTorch 或 BLAS，可通过 CPU 完成模型推理。

其实现利用 Kimi K3 的 MoE 架构，每层 896 个专家中仅激活 16 个，因此无需将约 1.56TB 完整模型权重加载进内存，而是将大部分专家权重存储在 NVMe 硬盘中，并按推理需求实时读取。

目前该方案仍有明显性能限制：在 8GB 内存模式下，生成一个 token 约需 32.7 秒，同时需要接近 1.7TB 高速存储空间。

开发者称，该方案更接近大模型推理基础设施优化方向的实验探索，尚不具备生产使用价值。

Disclaimer: Contains third-party opinions, does not constitute financial advice

Recommended Reading

Amazon announces a multi-billion dollar investment in Missouri to build a data center campus, expected to create over 400 long-term positions

06-16
Amazon announces a multi-billion dollar investment in Missouri to build a data center campus, expected to create over 400 long-term positions

Elon Musk's current personal net worth has risen to the range of $1.1 trillion to $1.2 trillion.

06-15
Elon Musk's current personal net worth has risen to the range of $1.1 trillion to $1.2 trillion.

OpenAI and Anthropic Employees Cash Out $14 Billion in Five Years

06-15
OpenAI and Anthropic Employees Cash Out $14 Billion in Five Years

Tencent Involved in Investment in Lin Junyang's AI Lab, Former Head of Alibaba's Qwen, Valued at $2 Billion

06-15
Tencent Involved in Investment in Lin Junyang's AI Lab, Former Head of Alibaba's Qwen, Valued at $2 Billion

Binance will delist the CVC/USDC, RPL/USDC, RVN/USDC, and XAI/USDC leveraged trading pairs on June 19

06-15
Binance will delist the CVC/USDC, RPL/USDC, RVN/USDC, and XAI/USDC leveraged trading pairs on June 19

U.S. Security Experts Unite to Urge Repeal of Anthropic Ban, Warn That Restricting Defensive Tools Will Lose the AI Race Against China

06-15
U.S. Security Experts Unite to Urge Repeal of Anthropic Ban, Warn That Restricting Defensive Tools Will Lose the AI Race Against China

Musk vows SpaceX revenue to reach $1 trillion by 2030

06-15
Musk vows SpaceX revenue to reach $1 trillion by 2030