This is a MXFP4_MOE quantization of the model Granite-4.0-H-Small
Model quantized with BF16 GGUF's from: https://huggingface.co/unsloth/granite-4.0-h-small-GGUF
Original model: https://huggingface.co/ibm-granite/granite-4.0-h-small
- Downloads last month
- 24
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for noctrex/Granite-4.0-H-Small-MXFP4_MOE-GGUF
Base model
ibm-granite/granite-4.0-h-small