Fix args in SGLang launch command (#9)
Browse files- Fix args in SGLang launch command (a6aac7760af929ceefcbbbcf41750f9a81d2f0db)
Co-authored-by: Ke Bao <[email protected]>
- docs/deploy_guidance.md +2 -2
docs/deploy_guidance.md
CHANGED
|
@@ -44,12 +44,12 @@ Similarly, here are the examples using TP in SGLang for Deployment.
|
|
| 44 |
Here is the simple example code to run TP8 on H200 in a sigle node:
|
| 45 |
|
| 46 |
``` bash
|
| 47 |
-
python -m sglang.launch_server --model-path $MODEL_PATH --tp 8 --trust-remote-code --tool-call-parser kimi_k2 --
|
| 48 |
```
|
| 49 |
|
| 50 |
**Key parameter notes:**
|
| 51 |
- `--tool-call-parser kimi_k2`: Required when enabling tool usage.
|
| 52 |
-
- `--
|
| 53 |
|
| 54 |
|
| 55 |
## KTransformers Deployment
|
|
|
|
| 44 |
Here is the simple example code to run TP8 on H200 in a sigle node:
|
| 45 |
|
| 46 |
``` bash
|
| 47 |
+
python -m sglang.launch_server --model-path $MODEL_PATH --tp 8 --trust-remote-code --tool-call-parser kimi_k2 --reasoning-parser kimi_k2
|
| 48 |
```
|
| 49 |
|
| 50 |
**Key parameter notes:**
|
| 51 |
- `--tool-call-parser kimi_k2`: Required when enabling tool usage.
|
| 52 |
+
- `--reasoning-parser kimi_k2`: Required for correctly processing reasoning content.
|
| 53 |
|
| 54 |
|
| 55 |
## KTransformers Deployment
|