Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
lew96123
/
qwen3.5-0.8b-custom-packed-8bit
like
0
Image-Text-to-Text
Transformers
Safetensors
qwen3_5
turboquant
custom-quantization
8bit
vector-quantization
conversational
arxiv:
2504.19874
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
qwen3.5-0.8b-custom-packed-8bit
2.15 GB
Ctrl+K
Ctrl+K
1 contributor
History:
10 commits
lew96123
Add Qwen3.5 family memory projection table (Q4_K_M vs TurboQuant 1-bit)
5e3e6d0
verified
11 days ago
.gitattributes
Safe
1.57 kB
Add 8bit quantized artifact
12 days ago
LICENSE
Safe
11.5 kB
Add 8bit quantized artifact
12 days ago
README.md
6.62 kB
Add Qwen3.5 family memory projection table (Q4_K_M vs TurboQuant 1-bit)
11 days ago
chat_template.jinja
Safe
7.76 kB
Add 8bit quantized artifact
12 days ago
config.json
Safe
2.91 kB
Add 8bit quantized artifact
12 days ago
eval_summary.json
Safe
488 Bytes
Add 8bit quantized artifact
11 days ago
load_quantized.py
Safe
12.1 kB
Fix load_quantized.py: TurboQuant-aware dequantization (was broken rowwise_symmetric loader)
11 days ago
merges.txt
Safe
3.35 MB
Add 8bit quantized artifact
12 days ago
packed_weights.safetensors
901 MB
xet
Add 8bit quantized artifact
12 days ago
preprocessor_config.json
Safe
390 Bytes
Add 8bit quantized artifact
12 days ago
quant_manifest.json
Safe
175 kB
Add 8bit quantized artifact
11 days ago
requirements.txt
Safe
115 Bytes
Add 8bit quantized artifact
12 days ago
sample_generations.json
Safe
1.8 kB
Add 8bit quantized artifact
11 days ago
tokenizer.json
Safe
12.8 MB
xet
Add 8bit quantized artifact
12 days ago
tokenizer_config.json
Safe
16.7 kB
Add 8bit quantized artifact
12 days ago
turboquant_weights.safetensors
1.23 GB
xet
Add 8bit quantized artifact
11 days ago
video_preprocessor_config.json
Safe
385 Bytes
Add 8bit quantized artifact
12 days ago
vocab.json
Safe
6.72 MB
Add 8bit quantized artifact
12 days ago