Safetensors
qwen2

[Bug] Missing thinking?

#1
by MrDevolver - opened

Hello, I have issues with this model. Do I understand this correctly that it is by default a thinking model? I'm using GGUF version of this model in LM Studio and by default it starts by the opening think tag, however the output in the said think tag is what appears to be the final response instead of the expected chain of thought of the model.

At first I thought the model may have broken chat template. Investigating further, I found out that the preview version of the model had an entirely different chat template. When I manually switched to the chat template that was used in preview version, the generated output started without the think tag and still no chain of thought, just the final response.

Is there any specific step I must perform in order to get proper output with chain of thought?

Sign up or log in to comment