Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

mradermacher
/
InsLLM-i1-GGUF

Transformers
GGUF
Chinese
imatrix
conversational
Model card Files Files and versions
xet
Community
InsLLM-i1-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 18 commits
mradermacher's picture
mradermacher
uploaded from rich1
c6cabdd verified 12 months ago
  • .gitattributes
    2.43 kB
    uploaded from rich1 12 months ago
  • InsLLM.i1-IQ1_M.gguf
    4.68 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-IQ2_M.gguf
    5.83 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-IQ2_XXS.gguf
    4.98 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-IQ3_M.gguf
    7.1 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-IQ3_XXS.gguf
    6.13 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-IQ4_NL.gguf
    8.18 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-IQ4_XS.gguf
    7.85 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-Q2_K.gguf
    5.91 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-Q2_K_S.gguf
    5.74 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-Q3_K_L.gguf
    7.84 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-Q3_K_M.gguf
    7.42 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-Q3_K_S.gguf
    6.77 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-Q4_K_M.gguf
    9.19 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-Q4_K_S.gguf
    8.56 GB
    xet
    uploaded from rich1 12 months ago
  • InsLLM.i1-Q6_K.gguf
    12.3 GB
    xet
    uploaded from rich1 12 months ago
  • README.md
    223 Bytes
    uploaded from rich1 12 months ago
  • imatrix.dat
    7.12 MB
    xet
    uploaded from rich1 12 months ago