113 GB

Ctrl+K

1 contributor

History: 82 commits

eaddario

Layer-wise quantization IQ3_S

0538aee verified about 1 year ago

imatrix
Regenerate importance matrices about 1 year ago
logits
Regenerate logits about 1 year ago
scores
Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores about 1 year ago
.gitattributes

1.65 kB
Update lfs attributes and ignores about 1 year ago
.gitignore

6.78 kB
Update lfs attributes and ignores about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-F16.gguf

15.2 GB
xet

Rename to F16 about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_M.gguf

3.29 GB
xet

Selective quantization IQ3_M about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_S.gguf

3.26 GB
xet

Layer-wise quantization IQ3_S about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-IQ4_NL.gguf

4.18 GB
xet

Layer-wise quantization IQ4_NL about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_L.gguf

3.54 GB
xet

Layer-wise quantization Q3_K_L about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_M.gguf

3.37 GB
xet

Layer-wise quantization Q3_K_M about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_S.gguf

3.14 GB
xet

Layer-wise quantization Q3_K_S about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_M.gguf

4.18 GB
xet

Layer-wise quantization Q4_K_M about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_S.gguf

4.06 GB
xet

Layer-wise quantization Q4_K_S about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_M.gguf

5.09 GB
xet

Layer-wise quantization Q5_K_M about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_S.gguf

4.97 GB
xet

Layer-wise quantization Q5_K_S about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-Q6_K.gguf

6.23 GB
xet

Layer-wise quantization Q6_K about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-Q8_0.gguf

7.27 GB
xet

Layer-wise quantization Q8_0 about 1 year ago
README.md

19.1 kB
Update README.md about 1 year ago