Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ This is a merge of pre-trained language models created using [mergekit](https://
|
|
| 14 |
## Merge Details
|
| 15 |
### Merge Method
|
| 16 |
|
| 17 |
-
This model was merged using the passthrough merge method. Every layer is doubled in order, from Qwen/Qwen2.5-72B-Instruct, with the MLP layers +
|
| 18 |
|
| 19 |
### Models Merged
|
| 20 |
|
|
|
|
| 14 |
## Merge Details
|
| 15 |
### Merge Method
|
| 16 |
|
| 17 |
+
This model was merged using the passthrough merge method. Every layer is doubled in order, from Qwen/Qwen2.5-72B-Instruct, with the MLP layers + 3 output layers only copied once, creating 132B parameters. No additional fine-tune has been done in this merged model.
|
| 18 |
|
| 19 |
### Models Merged
|
| 20 |
|