what is the model_max_length. 256 in `tokenizer_config.json` but 4096 in official example

#5
by bwinken - opened

model_max_length in tokenizer_config.json is 256
However, 4096 is used in official example.

Sign up or log in to comment