lsw825 ispobock commited on
Commit
f1ed9ca
·
verified ·
1 Parent(s): 1b9dbb7

Fix args in SGLang launch command (#9)

Browse files

- Fix args in SGLang launch command (a6aac7760af929ceefcbbbcf41750f9a81d2f0db)


Co-authored-by: Ke Bao <[email protected]>

Files changed (1) hide show
  1. docs/deploy_guidance.md +2 -2
docs/deploy_guidance.md CHANGED
@@ -44,12 +44,12 @@ Similarly, here are the examples using TP in SGLang for Deployment.
44
  Here is the simple example code to run TP8 on H200 in a sigle node:
45
 
46
  ``` bash
47
- python -m sglang.launch_server --model-path $MODEL_PATH --tp 8 --trust-remote-code --tool-call-parser kimi_k2 --reasoning_parser kimi_k2
48
  ```
49
 
50
  **Key parameter notes:**
51
  - `--tool-call-parser kimi_k2`: Required when enabling tool usage.
52
- - `--reasoning_parser kimi_k2`: Required for correctly processing reasoning content.
53
 
54
 
55
  ## KTransformers Deployment
 
44
  Here is the simple example code to run TP8 on H200 in a sigle node:
45
 
46
  ``` bash
47
+ python -m sglang.launch_server --model-path $MODEL_PATH --tp 8 --trust-remote-code --tool-call-parser kimi_k2 --reasoning-parser kimi_k2
48
  ```
49
 
50
  **Key parameter notes:**
51
  - `--tool-call-parser kimi_k2`: Required when enabling tool usage.
52
+ - `--reasoning-parser kimi_k2`: Required for correctly processing reasoning content.
53
 
54
 
55
  ## KTransformers Deployment