Fix Transformers config
Browse filesHey, thanks for the community contribution !
A bug was discovered and [fixed](https://huggingface.co/mistralai/Mistral-Medium-3.5-128B/commit/c4be198050fb5789774a55b92ed697becfbf20ae) in the original [model card](https://huggingface.co/mistralai/Mistral-Medium-3.5-128B) for Transformers' config. This has probably been propagated to your calibration so you might want to consider relaunching it.
Sorry for the inconvenience
- config.json +1 -1
config.json
CHANGED
|
@@ -1316,7 +1316,7 @@
|
|
| 1316 |
"factor": 64.0,
|
| 1317 |
"llama_4_scaling_beta": 0,
|
| 1318 |
"mscale": 1.0,
|
| 1319 |
-
"mscale_all_dim":
|
| 1320 |
"original_max_position_embeddings": 4096,
|
| 1321 |
"rope_theta": 1000000.0,
|
| 1322 |
"rope_type": "yarn",
|
|
|
|
| 1316 |
"factor": 64.0,
|
| 1317 |
"llama_4_scaling_beta": 0,
|
| 1318 |
"mscale": 1.0,
|
| 1319 |
+
"mscale_all_dim": 0.0,
|
| 1320 |
"original_max_position_embeddings": 4096,
|
| 1321 |
"rope_theta": 1000000.0,
|
| 1322 |
"rope_type": "yarn",
|