Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

mrtoots
/
TheDrummer-GLM-Steam-106B-A12B-v1-MLX-8Bit

MLX
Safetensors
glm4_moe
8-bit precision
Model card Files Files and versions
xet
Community
1

Instructions to use mrtoots/TheDrummer-GLM-Steam-106B-A12B-v1-MLX-8Bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • MLX

    How to use mrtoots/TheDrummer-GLM-Steam-106B-A12B-v1-MLX-8Bit with MLX:

    # Download the model from the Hub
    pip install huggingface_hub[hf_xet]
    
    huggingface-cli download --local-dir TheDrummer-GLM-Steam-106B-A12B-v1-MLX-8Bit mrtoots/TheDrummer-GLM-Steam-106B-A12B-v1-MLX-8Bit
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps
  • LM Studio
TheDrummer-GLM-Steam-106B-A12B-v1-MLX-8Bit
44.9 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 10 commits
Toots
Upload model-00009-of-00023.safetensors with huggingface_hub
9544157 verified 8 months ago
  • .gitattributes
    1.52 kB
    initial commit 8 months ago
  • model-00001-of-00023.safetensors
    5.09 GB
    xet
    Upload model-00001-of-00023.safetensors with huggingface_hub 8 months ago
  • model-00002-of-00023.safetensors
    4.98 GB
    xet
    Upload model-00002-of-00023.safetensors with huggingface_hub 8 months ago
  • model-00003-of-00023.safetensors
    4.98 GB
    xet
    Upload model-00003-of-00023.safetensors with huggingface_hub 8 months ago
  • model-00004-of-00023.safetensors
    4.98 GB
    xet
    Upload model-00004-of-00023.safetensors with huggingface_hub 8 months ago
  • model-00005-of-00023.safetensors
    4.98 GB
    xet
    Upload model-00005-of-00023.safetensors with huggingface_hub 8 months ago
  • model-00006-of-00023.safetensors
    4.98 GB
    xet
    Upload model-00006-of-00023.safetensors with huggingface_hub 8 months ago
  • model-00007-of-00023.safetensors
    4.98 GB
    xet
    Upload model-00007-of-00023.safetensors with huggingface_hub 8 months ago
  • model-00008-of-00023.safetensors
    4.98 GB
    xet
    Upload model-00008-of-00023.safetensors with huggingface_hub 8 months ago
  • model-00009-of-00023.safetensors
    4.98 GB
    xet
    Upload model-00009-of-00023.safetensors with huggingface_hub 8 months ago