File size: 1,822 Bytes
1048a9e 5649ad1 1048a9e 5649ad1 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 | ---
tags:
- heretic
- uncensored
- decensored
- abliterated
---
# This is a decensored version of [TheDrummer/Rocinante-XL-16B-v1](https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1), made using [Heretic](https://github.com/p-e-w/heretic) v1.2.0
## Abliteration parameters
| Parameter | Value |
| :-------- | :---: |
| **direction_index** | 22.20 |
| **attn.o_proj.max_weights.0** | 0: 1.26 |
| **attn.o_proj.max_weights.1** | 1: 0.64 |
| **attn.o_proj.max_weights.2** | 2: 1.41 |
| **attn.o_proj.max_weights.3** | 3: 0.94 |
| **attn.o_proj.max_weight_position** | 23.86 |
| **attn.o_proj.min_weights.0** | 0: 0.97 |
| **attn.o_proj.min_weights.1** | 1: 0.03 |
| **attn.o_proj.min_weights.2** | 2: 1.18 |
| **attn.o_proj.min_weights.3** | 3: 0.93 |
| **attn.o_proj.min_weight_distance** | 18.57 |
| **mlp.down_proj.max_weights.0** | 0: 1.23 |
| **mlp.down_proj.max_weights.1** | 1: 0.70 |
| **mlp.down_proj.max_weights.2** | 2: 1.35 |
| **mlp.down_proj.max_weights.3** | 3: 0.86 |
| **mlp.down_proj.max_weight_position** | 28.60 |
| **mlp.down_proj.min_weights.0** | 0: 0.37 |
| **mlp.down_proj.min_weights.1** | 1: 0.25 |
| **mlp.down_proj.min_weights.2** | 2: 1.01 |
| **mlp.down_proj.min_weights.3** | 3: 0.45 |
| **mlp.down_proj.min_weight_distance** | 5.96 |
## Performance
| Metric | This model | Original model ([TheDrummer/Rocinante-XL-16B-v1](https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1)) |
| :----- | :--------: | :---------------------------: |
| **KL divergence** | 0.0182 | 0 *(by definition)* |
| **Refusals** | 3/416 | 339/416 |
-----
Mistral v3 Tekken or Metharme.
Can think via \<thinking\> or \<think\>
Just like Roci X but better.
(Model card still a WIP)
FP16: https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1
GGUF: https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1-GGUF |