Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

AEON-7
/
Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation
Transformers
Safetensors
English
gemma4
image-text-to-text
gemma
google
dense
transformer
31b
nvfp4
fp4
4-bit precision
quantized
modelopt
awq
awq-full
activation-aware
weight-quantization
uncensored
abliterated
unfiltered
refusal-removed
deckard
heretic
vision
multimodal
tool-calling
function-calling
reasoning
thinking
chat
instruct
agentic
coding
creative-writing
dgx-spark
blackwell
gb10
grace-blackwell
nvidia
gpu
arm64
aarch64
vllm
openai-api
openai-compatible
fp8-kv-cache
prefix-caching
chunked-prefill
sliding-window-attention
english
production-ready
speculative-decoding
eagle
conversational
8-bit precision
Model card Files Files and versions
xet
Community
1
Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4
20.5 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 11 commits
AEON-7's picture
AEON-7
Add speculative decoding docs with E4B drafter
5ca45a4 verified 7 days ago
  • .gitattributes
    1.57 kB
    Full NVFP4 AWQ quantization of DavidAU DECKARD HERETIC 31B-it 9 days ago
  • README.md
    13.5 kB
    Add speculative decoding docs with E4B drafter 7 days ago
  • chat_template-instruct.jinja
    12 kB
    Full NVFP4 AWQ quantization of DavidAU DECKARD HERETIC 31B-it 9 days ago
  • chat_template.jinja
    12.1 kB
    Full NVFP4 AWQ quantization of DavidAU DECKARD HERETIC 31B-it 9 days ago
  • config.json
    5.79 kB
    Full NVFP4 AWQ quantization of DavidAU DECKARD HERETIC 31B-it 9 days ago
  • generation_config.json
    171 Bytes
    Full NVFP4 AWQ quantization of DavidAU DECKARD HERETIC 31B-it 9 days ago
  • hf_quant_config.json
    407 Bytes
    Full NVFP4 AWQ quantization of DavidAU DECKARD HERETIC 31B-it 9 days ago
  • model.safetensors
    20.5 GB
    xet
    Upgrade to AWQ_FULL (exhaustive grid search, 2048 calibration samples) 9 days ago
  • processor_config.json
    1.69 kB
    Full NVFP4 AWQ quantization of DavidAU DECKARD HERETIC 31B-it 9 days ago
  • tokenizer.json
    32.2 MB
    xet
    Full NVFP4 AWQ quantization of DavidAU DECKARD HERETIC 31B-it 9 days ago
  • tokenizer_config.json
    2.07 kB
    Full NVFP4 AWQ quantization of DavidAU DECKARD HERETIC 31B-it 9 days ago