When deploying with vLLM, encountered AttributeError: 'dict' object has no attribute 'model_type'
#159
by
czyPL
- opened
Issue: While following the documentation at https://docs.vllm.ai/projects/recipes/en/latest/OpenAI/GPT-OSS.html to deploy the model, encountered AttributeError: 'dict' object has no attribute 'model_type'.
Commands executed:
uv venv
source .venv/bin/activate
uv pip install vllm==0.10.2 --torch-backend=auto
vllm serve openai/gpt-oss-120b --async-scheduling
Solution:
This issue was caused by the recent update of transformers to version 4.57.2. Downgrading to version 4.57.1 resolves the problem:
uv pip install transformers==4.57.1