This is a MXFP4_MOE quantization of the model OLMoE-1B-7B-0125-Instruct
Model quantized with F16 GGUF’s from: https://huggingface.co/DevQuasar/allenai.OLMoE-1B-7B-0125-Instruct-GGUF
Original model: https://huggingface.co/allenai/OLMoE-1B-7B-0125-Instruct
- Downloads last month
- 26
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for noctrex/OLMoE-1B-7B-0125-Instruct-MXFP4_MOE-GGUF
Base model
allenai/OLMoE-1B-7B-0125 Finetuned
allenai/OLMoE-1B-7B-0125-SFT Finetuned
allenai/OLMoE-1B-7B-0125-DPO Finetuned
allenai/OLMoE-1B-7B-0125-Instruct