mon_tokenizer / mon_tokenizer.vocab

feat: update tokenizer artifacts with 41.4M character corpus

39ad643 about 1 month ago

1 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.