README.md

metadata

license: apache-2.0

To load the tokeniser for this model, do not use AutoTokenizer. Instead, install TkTkT and run:

from tktkt.models.bpe.base import ClassicBPE
tokenizer = ClassicBPE.from_pretrained("Bauwens/RoBERTa-nl_BPE_39k")