r-three/tokenizer_robustness_completion_turkish
Viewer
•
Updated
•
621
•
41
TokSuite Tokenization Robustness Benchmark
-
-
r-three/tokenizer_robustness_completion_chinese
Viewer • Updated • 485 • 62 -
r-three/tokenizer_robustness_completion_math
Viewer • Updated • 189 • 38 -
r-three/tokenizer_robustness_completion_farsi
Viewer • Updated • 747 • 41 -
r-three/tokenizer_robustness_completion_english
Viewer • Updated • 1.14k • 81 -
r-three/tokenizer_robustness_completion_italian
Viewer • Updated • 1.09k • 26 -
r-three/tokenizer_robustness_completion_stem
Viewer • Updated • 614 • 36 -
r-three/tokenizer_robustness_completion_general
Viewer • Updated • 68 • 24