Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
chatpdflocal
/
llama3.1-8b-gguf
like
29
Follow
chatpdflocal
9
Transformers
GGUF
English
llama3.1
macos
chatpdf
local
text-generation-inference
meta
facebook
llama
llama.cpp
legal
llama3.1-8b
quantization
conversational
License:
llama3.1
Model card
Files
Files and versions
xet
Community
3
Deploy
Use this model
main
llama3.1-8b-gguf
36.7 GB
Ctrl+K
Ctrl+K
2 contributors
History:
29 commits
Vincent-Lee
Update README.md
3d3d5f9
verified
25 days ago
.gitattributes
Safe
1.81 kB
Upload ggml-model-f16.gguf
over 1 year ago
README.md
1.41 kB
Update README.md
25 days ago
ggml-model-Q2_K.gguf
Safe
3.18 GB
xet
Upload ggml-model-Q2_K.gguf
over 1 year ago
ggml-model-Q3_K_M.gguf
Safe
4.02 GB
xet
Upload ggml-model-Q3_K_M.gguf
over 1 year ago
ggml-model-Q4_K_M.gguf
Safe
4.92 GB
xet
Upload ggml-model-Q4_K_M.gguf
over 1 year ago
ggml-model-Q8_0.gguf
Safe
8.54 GB
xet
Upload ggml-model-Q8_0.gguf
over 1 year ago
ggml-model-f16.gguf
Safe
16.1 GB
xet
Upload ggml-model-f16.gguf
over 1 year ago