How to make batched requests using Kimi VL??
#30
by
qsstcl
- opened
Does Kimi VL support batched requests
Yes, it does. You can deploy it with the vLLM or sglang. Please refer to https://github.com/MoonshotAI/Kimi-VL?tab=readme-ov-file#8-deployment