Re-order text
Browse files
README.md
CHANGED
|
@@ -15,6 +15,11 @@ library_name: transformers
|
|
| 15 |
# Qwen2.5-0.5B-Instruct
|
| 16 |
|
| 17 |
## Introduction
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
|
| 19 |
This repo contains an **unmodified version** of the instruction-tuned 0.5B Qwen2.5 model, which has the following features:
|
| 20 |
- Type: Causal Language Models
|
|
@@ -26,12 +31,6 @@ This repo contains an **unmodified version** of the instruction-tuned 0.5B Qwen2
|
|
| 26 |
- Number of Attention Heads (GQA): 14 for Q and 2 for KV
|
| 27 |
- Context Length: Full 32,768 tokens and generation 8192 tokens
|
| 28 |
|
| 29 |
-
This model is intended for use in the [Gensyn RL Swarm](https://www.gensyn.ai/articles/rl-swarm), to finetune locally using peer-to-peer reinforcement learning post-training.
|
| 30 |
-
|
| 31 |
-
Once finetuned, the model can be used as normal in any workflow, for details on how to do this please refer to the [original model documentation](https://qwen.readthedocs.io/en/latest/).
|
| 32 |
-
|
| 33 |
-
For more details on the original model, please refer to the original repository [here](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct).
|
| 34 |
-
|
| 35 |
## Requirements
|
| 36 |
|
| 37 |
This model is intended for use in the [Gensyn RL Swarm](https://www.gensyn.ai/articles/rl-swarm) system, for details on model requirements when using outside of a swarm, refer to the original Qwen repo [here](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct).
|
|
|
|
| 15 |
# Qwen2.5-0.5B-Instruct
|
| 16 |
|
| 17 |
## Introduction
|
| 18 |
+
This model is intended for use in the [Gensyn RL Swarm](https://www.gensyn.ai/articles/rl-swarm), to finetune locally using peer-to-peer reinforcement learning post-training.
|
| 19 |
+
|
| 20 |
+
Once finetuned, the model can be used as normal in any workflow, for details on how to do this please refer to the [original model documentation](https://qwen.readthedocs.io/en/latest/).
|
| 21 |
+
|
| 22 |
+
For more details on the original model, please refer to the original repository [here](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct).
|
| 23 |
|
| 24 |
This repo contains an **unmodified version** of the instruction-tuned 0.5B Qwen2.5 model, which has the following features:
|
| 25 |
- Type: Causal Language Models
|
|
|
|
| 31 |
- Number of Attention Heads (GQA): 14 for Q and 2 for KV
|
| 32 |
- Context Length: Full 32,768 tokens and generation 8192 tokens
|
| 33 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
## Requirements
|
| 35 |
|
| 36 |
This model is intended for use in the [Gensyn RL Swarm](https://www.gensyn.ai/articles/rl-swarm) system, for details on model requirements when using outside of a swarm, refer to the original Qwen repo [here](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct).
|