Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
caiovicentino1
/
Qwen3.5-9B-Claude-Opus-HLWQ-Q5
like
3
Text Generation
Transformers
Safetensors
4 languages
qwen3_5
image-text-to-text
hlwq
quantized
compressed-tensors
int4
marlin
vllm
conversational
8-bit precision
arxiv:
2502.02617
arxiv:
2603.29078
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
625d7b6
Qwen3.5-9B-Claude-Opus-HLWQ-Q5
9.12 GB
Ctrl+K
Ctrl+K
1 contributor
History:
4 commits
caiovicentino1
Upload ppl_comparison.png with huggingface_hub
625d7b6
verified
25 days ago
.gitattributes
Safe
1.57 kB
PolarQuant Q5 unified (PPL 6.54, 7.1GB, 43 tok/s)
25 days ago
README.md
1.12 kB
Upload README.md with huggingface_hub
25 days ago
config.json
Safe
3.47 kB
PolarQuant Q5 unified (PPL 6.54, 7.1GB, 43 tok/s)
25 days ago
model-00000-of-00002.safetensors
5.32 GB
xet
PolarQuant Q5 unified (PPL 6.54, 7.1GB, 43 tok/s)
25 days ago
model-00001-of-00002.safetensors
3.77 GB
xet
PolarQuant Q5 unified (PPL 6.54, 7.1GB, 43 tok/s)
25 days ago
model.safetensors.index.json
Safe
75.9 kB
PolarQuant Q5 unified (PPL 6.54, 7.1GB, 43 tok/s)
25 days ago
polar_config.json
Safe
45.3 kB
PolarQuant Q5 unified (PPL 6.54, 7.1GB, 43 tok/s)
25 days ago
ppl_comparison.png
Safe
51.3 kB
Upload ppl_comparison.png with huggingface_hub
25 days ago
processor_config.json
Safe
1.3 kB
PolarQuant Q5 unified (PPL 6.54, 7.1GB, 43 tok/s)
25 days ago
tokenizer.json
Safe
20 MB
xet
PolarQuant Q5 unified (PPL 6.54, 7.1GB, 43 tok/s)
25 days ago
tokenizer_config.json
Safe
5.4 kB
PolarQuant Q5 unified (PPL 6.54, 7.1GB, 43 tok/s)
25 days ago
