MiniMax-M2.7-RotorQuant-MLX-5bit

MLX 5-bit quantized variant of MiniMaxAI/MiniMax-M2.7 with RotorQuant KV-cache compression, optimized for Apple Silicon.

Overview

MiniMax-M2.7 is a massive 256-expert Mixture-of-Experts (MoE) model with 8 experts active per token, totaling approximately 456 billion parameters. This variant combines 5-bit MLX weight quantization with RotorQuant KV-cache quantization for deployment on Apple Silicon hardware.

RotorQuant applies a learned Hadamard rotation matrix to keys and values before quantization, smoothing the activation distribution for better quality retention. The 5-bit weight quantization offers a strong balance between quality and memory footprint.

Property	Value
Architecture	MoE (256 experts, 8 active/token)
Total Parameters	~456B
Layers	62
Hidden Size	3072
Attention Heads	48
Weight Quantization	5-bit (MLX)
KV-Cache Quantization	RotorQuant
Estimated Size	~280 GB
Base Model	MiniMaxAI/MiniMax-M2.7

Quickstart

pip install mlx-lm

from mlx_lm import load, generate

model, tokenizer = load("majentik/MiniMax-M2.7-RotorQuant-MLX-5bit")

prompt = "What is a Comprehensive Geriatric Assessment?"
messages = [{"role": "user", "content": prompt}]
text = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)

response = generate(
    model,
    tokenizer,
    prompt=text,
    max_tokens=512,
)
print(response)

RotorQuant vs TurboQuant

Feature	RotorQuant	TurboQuant
Technique	Rotation-based KV quantization (Hadamard transform)	Asymmetric per-channel KV quantization
Throughput	Slightly lower throughput (rotation overhead)	Higher throughput, lower latency
Quality	Better quality preservation at low bit-widths	Good quality preservation
Best For	Quality-sensitive tasks, research	High-throughput serving, long contexts

Memory Estimates (Apple Silicon)

Variant	Estimated Size	Minimum Unified Memory
MLX 8-bit	~456 GB	512 GB (Mac Studio M2/M3/M4 Ultra)
MLX 5-bit	~280 GB	384 GB
MLX 4-bit	~225 GB	256 GB
MLX 3-bit	~170 GB	192 GB
MLX 2-bit	~110 GB	128 GB

Note: 5-bit quantization requires Apple Silicon with 384 GB+ unified memory, such as a Mac Studio with M2/M3/M4 Ultra.

See Also

• MiniMaxAI/MiniMax-M2.7 -- Base model
• majentik/MiniMax-M2.7-RotorQuant -- KV-cache only (transformers)
• majentik/MiniMax-M2.7-TurboQuant-MLX-5bit -- TurboQuant MLX 5-bit
• majentik/MiniMax-M2.7-RotorQuant-MLX-8bit -- MLX 8-bit
• majentik/MiniMax-M2.7-RotorQuant-MLX-4bit -- MLX 4-bit