Inference Providers
Active filters: torchao
Text Generation
• 8B • Updated • 4
mekpro/qwen3_thaipbs_qa-torchao
Feature Extraction
• Updated • 3
zlyngkhoi/meta-llama-Llama-3.2-1B_dynamic_torchao_v1
zlyngkhoi/meta-llama-Llama-3.2-1B_dynamic_torchao_v2
zlyngkhoi/meta-llama-Llama-3.2-1B_dynamic_torchao_lightning
zlyngkhoi/meta-llama-Llama-3.2-1B_dynamic_torchao_lightning_path
vinhnx90/Qwen3-4B-QAT-TorchAO-int4-torchao
Feature Extraction
• Updated • 2
• 1
liangel/gemma-3-12b-it-FP8
Image-Text-to-Text
• 12B • Updated • 4
Feature Extraction
• Updated • 2
liangel/Qwen3-8B-FP8-underscore
Text Generation
• 8B • Updated • 4
liangel/Qwen3-8B-FP8-colon
Text Generation
• 8B • Updated • 3
newmindai/Llama-3.1-8B-Instruct-w16a16-tw
Text Generation
• 8B • Updated lvj/Qwen3-4B-parq-2b-weight-4b-embed-shared-gsm
Text Generation
• Updated • 1
liangel/Qwen3-8B-FP8-vllm-correct
Text Generation
• 8B • Updated • 3
liangel/Qwen3-8B-INT8-INT4-vllm-correct
Text Generation
• 8B • Updated • 3
jaytonde05/qat_model-torchao
Feature Extraction
• Updated • 3
jaytonde05/ptq_exp_04-INT4
Text Generation
• Updated jaytonde05/Qwen3_4B_QAT-torchao-embed-bug
Updated
jaytonde05/Qwen3_4B_PTQ_Manual
Text Generation
• Updated liangel/Qwen3-8B-AWQ-INT4-vllm-correct
Text Generation
• 8B • Updated • 4
liangel/Qwen3-8B-INT4-vllm-correct
Text Generation
• 8B • Updated • 3
jaytonde05/test_model_qat_torchao
Updated
newmindai/Llama-3.1-8B-Instruct-w16a16-4nodes-bs32
Text Generation
• 8B • Updated • 1
newmindai/Llama-3.1-8B-Instruct-w16a16-8nodes-bs32
Text Generation
• 8B • Updated jaytonde05/Qwen3_4B_BUG_FIXQAT
jaytonde05/Qwen3_4B_QAT-torchao
Updated
metascroy/Qwen3-4B-int8-int4-unsloth-v2
Text Generation
• Updated • 16
medmekk/llama-3.2-1b-float8-torchao
1B • Updated • 3
medmekk/Llama-3.2-1B-float8-torchao-2
1B • Updated akba08/flux_cinematic_photography_finetuned
Text-to-Image
• Updated • 18
•