SmolVLM rkllm conversion

#1
by marojeon - opened

Thank you very much for providing the RKLLM engine.
I attempted to convert SmolVLM to RKLLM, but the text decoder only produced meaningless garbage output.
Could you please share your thoughts on what I might have done wrong?
Thank you very much for your time and insight.

Can you please show me your script and output

Thanks for your comment.

It seems that the safetensors file of the SmolVLM model I downloaded via the Hugging Face Python API was outdated.

After manually downloading the model.safetensors file directly from the following URL, everything worked perfectly:
https://huggingface.co/HuggingFaceTB/SmolVLM-256M-Instruct/tree/main

I hope this helps anyone experiencing the same issue.

I build the rkllm using version 1.2.1 .let. Me rebuild this with latest version , and check if it's still showing the issue.

Sign up or log in to comment