Transformers
marin-tokenizer / tokenizer.json
dlwh's picture
Upload tokenizer
37a7a2a verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
881c9c36c359e1617afef6f7583403567931b7b4f43f6552d2b2155a131650a2
Pointer size:
133 Bytes
·
Size of remote file:
17.2 MB
·
Xet backed hash:
5de30f9b382a76d80a684575cc52cf4acba17b51e87f9dd450ebb96888d1fce4

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.