---
tags:
- heretic
- uncensored
- decensored
- abliterated
---
# This is a decensored version of [TheDrummer/Rocinante-XL-16B-v1](https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1), made using [Heretic](https://github.com/p-e-w/heretic) v1.2.0

## Abliteration parameters

| Parameter | Value |
| :-------- | :---: |
| **direction_index** | 22.20 |
| **attn.o_proj.max_weights.0** | 0: 1.26 |
| **attn.o_proj.max_weights.1** | 1: 0.64 |
| **attn.o_proj.max_weights.2** | 2: 1.41 |
| **attn.o_proj.max_weights.3** | 3: 0.94 |
| **attn.o_proj.max_weight_position** | 23.86 |
| **attn.o_proj.min_weights.0** | 0: 0.97 |
| **attn.o_proj.min_weights.1** | 1: 0.03 |
| **attn.o_proj.min_weights.2** | 2: 1.18 |
| **attn.o_proj.min_weights.3** | 3: 0.93 |
| **attn.o_proj.min_weight_distance** | 18.57 |
| **mlp.down_proj.max_weights.0** | 0: 1.23 |
| **mlp.down_proj.max_weights.1** | 1: 0.70 |
| **mlp.down_proj.max_weights.2** | 2: 1.35 |
| **mlp.down_proj.max_weights.3** | 3: 0.86 |
| **mlp.down_proj.max_weight_position** | 28.60 |
| **mlp.down_proj.min_weights.0** | 0: 0.37 |
| **mlp.down_proj.min_weights.1** | 1: 0.25 |
| **mlp.down_proj.min_weights.2** | 2: 1.01 |
| **mlp.down_proj.min_weights.3** | 3: 0.45 |
| **mlp.down_proj.min_weight_distance** | 5.96 |

## Performance

| Metric | This model | Original model ([TheDrummer/Rocinante-XL-16B-v1](https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1)) |
| :----- | :--------: | :---------------------------: |
| **KL divergence** | 0.0182 | 0 *(by definition)* |
| **Refusals** | 3/416 | 339/416 |

-----

Mistral v3 Tekken or Metharme.

Can think via \<thinking\> or \<think\>

Just like Roci X but better.

(Model card still a WIP)

FP16: https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1
GGUF: https://huggingface.co/TheDrummer/Rocinante-XL-16B-v1-GGUF