juliendenize commited on
Commit
b6c512b
·
verified ·
1 Parent(s): 08d2f97

Fix Transformers config

Browse files

Hey, thanks for the community contribution !

A bug was discovered and [fixed](https://huggingface.co/mistralai/Mistral-Medium-3.5-128B/commit/c4be198050fb5789774a55b92ed697becfbf20ae) in the original [model card](https://huggingface.co/mistralai/Mistral-Medium-3.5-128B) for Transformers' config. This has probably been propagated to your calibration so you might want to consider relaunching it.

Sorry for the inconvenience

Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -1316,7 +1316,7 @@
1316
  "factor": 64.0,
1317
  "llama_4_scaling_beta": 0,
1318
  "mscale": 1.0,
1319
- "mscale_all_dim": 1.0,
1320
  "original_max_position_embeddings": 4096,
1321
  "rope_theta": 1000000.0,
1322
  "rope_type": "yarn",
 
1316
  "factor": 64.0,
1317
  "llama_4_scaling_beta": 0,
1318
  "mscale": 1.0,
1319
+ "mscale_all_dim": 0.0,
1320
  "original_max_position_embeddings": 4096,
1321
  "rope_theta": 1000000.0,
1322
  "rope_type": "yarn",