janakhpon
/

mon_tokenizer

Model card Files Files and versions

mon_tokenizer / added_tokens.json

janakhpon's picture

feat: restructure and upgrade to 32k vocab model (v2)

e909ce1 about 2 months ago

history blame contribute delete

21 Bytes

	{
	"<pad>": 32000
	}