Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

ubergarm
/
DeepSeek-V3-0324-GGUF

Text Generation
GGUF
mla
imatrix
deepseek_v3
conversational
ik_llama.cpp
Model card Files Files and versions
xet
Community
7
DeepSeek-V3-0324-GGUF / DeepSeek-V3-0324-IQ4_K_R4
415 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 1 commit
ubergarm's picture
ubergarm
Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks
e1ce4cd about 1 year ago
  • DeepSeek-V3-0324-IQ4_K_R4-00001-of-00010.gguf
    41.2 GB
    xet
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks about 1 year ago
  • DeepSeek-V3-0324-IQ4_K_R4-00002-of-00010.gguf
    42.5 GB
    xet
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks about 1 year ago
  • DeepSeek-V3-0324-IQ4_K_R4-00003-of-00010.gguf
    42.5 GB
    xet
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks about 1 year ago
  • DeepSeek-V3-0324-IQ4_K_R4-00004-of-00010.gguf
    42.5 GB
    xet
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks about 1 year ago
  • DeepSeek-V3-0324-IQ4_K_R4-00005-of-00010.gguf
    42.5 GB
    xet
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks about 1 year ago
  • DeepSeek-V3-0324-IQ4_K_R4-00006-of-00010.gguf
    42.5 GB
    xet
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks about 1 year ago
  • DeepSeek-V3-0324-IQ4_K_R4-00007-of-00010.gguf
    42.5 GB
    xet
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks about 1 year ago
  • DeepSeek-V3-0324-IQ4_K_R4-00008-of-00010.gguf
    42.5 GB
    xet
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks about 1 year ago
  • DeepSeek-V3-0324-IQ4_K_R4-00009-of-00010.gguf
    42.5 GB
    xet
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks about 1 year ago
  • DeepSeek-V3-0324-IQ4_K_R4-00010-of-00010.gguf
    33.5 GB
    xet
    Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks about 1 year ago