Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -35,9 +35,9 @@ library_name: mlx
|
|
| 35 |
|
| 36 |
# Kimi-K2.6-Small-JANGTQ
|
| 37 |
|
| 38 |
-
**This is now a ~586B-A32B MoE** (down from Kimi K2.6's
|
| 39 |
-
aggressive 45% routed-expert prune + 2-bit JANGTQ
|
| 40 |
-
runnable on a 256 GB Apple Silicon Mac.
|
| 41 |
|
| 42 |
- **Source**: [moonshotai/Kimi-K2.6](https://huggingface.co/moonshotai) (Moonshot AI's
|
| 43 |
MLA/MoE flagship, INT4 pack-quantized base)
|
|
|
|
| 35 |
|
| 36 |
# Kimi-K2.6-Small-JANGTQ
|
| 37 |
|
| 38 |
+
**This is now a ~586B-A32B MoE — 153 GB on disk** (down from Kimi K2.6's
|
| 39 |
+
~610 GB / ~1T base) — aggressive 45% routed-expert prune + 2-bit JANGTQ
|
| 40 |
+
quantization, runnable on a 256 GB Apple Silicon Mac.
|
| 41 |
|
| 42 |
- **Source**: [moonshotai/Kimi-K2.6](https://huggingface.co/moonshotai) (Moonshot AI's
|
| 43 |
MLA/MoE flagship, INT4 pack-quantized base)
|