File size: 1,384 Bytes
b833cee c61316f b833cee c61316f b833cee c61316f b833cee c61316f b833cee c61316f b833cee c61316f b833cee c61316f b833cee c61316f b833cee c61316f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 |
---
pipeline_tag: text-generation
library_name: transformers
base_model:
- mistralai/Voxtral-Mini-3B-2507
tags:
- heretic
- uncensored
- decensored
- abliterated
---
# This is a decensored version of [minpeter/Voxtral-Mini-3B-Text-2507-hf](https://huggingface.co/minpeter/Voxtral-Mini-3B-Text-2507-hf), made using [Heretic](https://github.com/p-e-w/heretic) v1.0.1
## Abliteration parameters
| Parameter | Value |
| :-------- | :---: |
| **direction_index** | 14.47 |
| **attn.o_proj.max_weight** | 1.27 |
| **attn.o_proj.max_weight_position** | 17.46 |
| **attn.o_proj.min_weight** | 0.98 |
| **attn.o_proj.min_weight_distance** | 8.89 |
| **mlp.down_proj.max_weight** | 1.11 |
| **mlp.down_proj.max_weight_position** | 21.50 |
| **mlp.down_proj.min_weight** | 1.02 |
| **mlp.down_proj.min_weight_distance** | 15.14 |
## Performance
| Metric | This model | Original model ([minpeter/Voxtral-Mini-3B-Text-2507-hf](https://huggingface.co/minpeter/Voxtral-Mini-3B-Text-2507-hf)) |
| :----- | :--------: | :---------------------------: |
| **KL divergence** | 0.06 | 0 *(by definition)* |
| **Refusals** | 4/100 | 99/100 |
-----
This is a version of [Voxtral-Mini-3B-2507](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507) that removes the whisper feature and retains only the language model functionality.
It is similar to the unreleased **"Ministral-3B-Instruct"** model. |