Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
firefly-mixtral-8x7b-GGUF

Transformers
GGUF
English
mixtral
Model card Files Files and versions
xet
Community
firefly-mixtral-8x7b-GGUF
192 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 8 commits
TheBloke's picture
TheBloke
GGUF model commit (made with llama.cpp commit a7aee47)
09e2701 over 2 years ago
  • .gitattributes
    1.99 kB
    GGUF model commit (made with llama.cpp commit a7aee47) over 2 years ago
  • firefly-mixtral-8x7b.Q2_K.gguf
    15.6 GB
    xet
    GGUF model commit (made with llama.cpp commit a7aee47) over 2 years ago
  • firefly-mixtral-8x7b.Q3_K_M.gguf
    20.4 GB
    xet
    GGUF model commit (made with llama.cpp commit a7aee47) over 2 years ago
  • firefly-mixtral-8x7b.Q4_0.gguf
    26.4 GB
    xet
    GGUF model commit (made with llama.cpp commit a7aee47) over 2 years ago
  • firefly-mixtral-8x7b.Q4_K_M.gguf
    26.4 GB
    xet
    GGUF model commit (made with llama.cpp commit a7aee47) over 2 years ago
  • firefly-mixtral-8x7b.Q5_0.gguf
    32.2 GB
    xet
    GGUF model commit (made with llama.cpp commit a7aee47) over 2 years ago
  • firefly-mixtral-8x7b.Q5_K_M.gguf
    32.2 GB
    xet
    GGUF model commit (made with llama.cpp commit a7aee47) over 2 years ago
  • firefly-mixtral-8x7b.Q6_K.gguf
    38.4 GB
    xet
    GGUF model commit (made with llama.cpp commit a7aee47) over 2 years ago