bug in `tokenizer.json`

#9
by J22 - opened

"<SPECIAL_10": 10, shall be "<SPECIAL_10>": 10,

Swiss AI Initiative org

thanks for reporting, we'll take a look

Swiss AI Initiative org

thanks again for the report, the issue has been resolved now.

mansaripo changed discussion status to closed

Sign up or log in to comment