Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

eaddario
/
Olmo-3-7B-Instruct-GGUF

Text Generation
GGUF
English
quant
experimental
target_bpw
conversational
Model card Files Files and versions
xet
Community
Olmo-3-7B-Instruct-GGUF
50.9 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 12 commits
eaddario's picture
eaddario
Target 2.00 bpw quantization (IQ2_XXS)
284abe5 verified 4 months ago
  • imatrix
    Generate imatrix 4 months ago
  • logits
    Generate base model logits 4 months ago
  • .gitattributes
    1.64 kB
    Update .gitattributes 4 months ago
  • .gitignore
    6.78 kB
    Add .gitignore 4 months ago
  • Olmo-3-7B-Instruct-F16.gguf
    14.6 GB
    xet
    Convert safetensor to GGUF @ F16 4 months ago
  • Olmo-3-7B-Instruct-IQ1_L.gguf
    1.6 GB
    xet
    Target 1.75 bpw quantization (IQ1_L) 4 months ago
  • Olmo-3-7B-Instruct-IQ2_S.gguf
    2.06 GB
    xet
    Target 2.25 bpw quantization (IQ2_S) 4 months ago
  • Olmo-3-7B-Instruct-IQ2_XS.gguf
    1.94 GB
    xet
    Target 2.125 bpw quantization (IQ2_XS) 4 months ago
  • Olmo-3-7B-Instruct-IQ2_XXS.gguf
    1.83 GB
    xet
    Target 2.00 bpw quantization (IQ2_XXS) 4 months ago
  • Olmo_3_7B_Instruct-9ae8fd725171c639.bpw_state
    70.9 kB
    xet
    Generate BPW computation checkpoint 4 months ago
  • README.md
    395 Bytes
    Update README.md 4 months ago