kshitijthakkar/qwen3.5-moe-0.87B-d0.8B
Image-Text-to-Text • 1B • Updated • 31
Qwen3.5 Dense-to-MoE Weight Transfer
Qwen3.5 MoE models from dual-source weight transfer (dense backbone + 35B-A3B experts). Hybrid DeltaNet + GQA attention.
-
-
kshitijthakkar/qwen3.5-moe-2.3B-d2B
Image-Text-to-Text • 3B • Updated • 4 -
kshitijthakkar/qwen3.5-moe-4.7B-d4B
Image-Text-to-Text • 5B • Updated • 29 -
kshitijthakkar/qwen3.5-tiny-test
Image-Text-to-Text • 0.1B • Updated • 4 -
kshitijthakkar/qwen3.5-from-scratch-tiny
2B • Updated • 5 -
kshitijthakkar/qwen3.5-0.8b-moe-from-scratch
3B • Updated • 2