This is a MXFP4_MOE quantization of the model DeepSeek-MoE-16B-Chat
Original model: https://huggingface.co/deepseek-ai/deepseek-moe-16b-chat
- Downloads last month
- 54
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for noctrex/DeepSeek-MoE-16B-Chat-MXFP4_MOE-GGUF
Base model
deepseek-ai/deepseek-moe-16b-chat