Inference Providers
Active filters: vllm
yejingfu/nmagic-Meta-Llama-3.1-70B-Instruct-FP8
Text Generation
• 71B • Updated • 3
RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4
Text Generation
• 8B • Updated • 7
• 1
SicariusSicariiStuff/DeepSeek-Coder-V2-Instruct-FP8
236B • Updated • 6
RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text
• 73B • Updated • 71
mistralai/Mistral-Large-Instruct-2411
Updated • 7.94k
• 257
mistralai/Pixtral-Large-Instruct-2411
Updated • 150
• 433
RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic
Text Generation
• 8B • Updated • 4
• 2
yejingfu/nmagic-Meta-Llama-3-70B-Instruct-FP8
71B • Updated • 1
RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic
Text Generation
• 8B • Updated • 7
Model-SafeTensors/Meta-Llama-3-8B-Instruct-FP8
8B • Updated • 6
mistral-community/Pixtral-Large-Instruct-2411
Image-Text-to-Text
• 124B • Updated • 181
• 6
mgoin/Pixtral-Large-Instruct-2411
Updated
MikeRoz/mistralai_Mistral-Large-Instruct-2411-4.0bpw-h6-exl2
Updated • 5
• 4
RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic
Text Generation
• 8B • Updated • 5
• 1
ijohn07/Ministral-8B-Instruct-2410-Q8_0-GGUF
8B • Updated • 2
bartowski/Mistral-Large-Instruct-2411-exl2
Text Generation
• Updated • 11
• 4
TechxGenus/Mistral-Large-Instruct-2411-AWQ
123B • Updated • 7.17k
• 8
bullerwins/Mistral-Large-Instruct-2411-exl2_4.0bpw
bullerwins/Mistral-Large-Instruct-2411-exl2_4.5bpw
Updated • 11
bullerwins/Mistral-Large-Instruct-2411-exl2_5.0bpw
Updated • 16
Sicarius-Prototyping/Pixtral-Large-Instruct-2411
124B • Updated • 7
RedHatAI/Pixtral-Large-Instruct-2411-hf-FP8-dynamic
Image-Text-to-Text
• 124B • Updated • 52
• 1
tokoin/Ministral-8B-Instruct-2410-IQ4_NL-GGUF
MikeRoz/mistralai_Mistral-Large-Instruct-2411-6.0bpw-h6-exl2
BigHuggyD/Mistral-Large-Instruct-2411_exl2_4.0bpw_h6
Updated • 4
• 1
wolfram/Mistral-Large-Instruct-2411-2.75bpw-h6-exl2
Updated • 4
• 2
BigHuggyD/Mistral-Large-Instruct-2411_exl2_5.0bpw_h6
TechxGenus/Mistral-Large-Instruct-2411-GPTQ
123B • Updated • 75
• 2
BigHuggyD/Mistral-Large-Instruct-2411_exl2_6.0bpw_h6
bullerwins/Mistral-Large-Instruct-2411-exl2_3.0bpw
Updated • 3
• 1