Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
janakhpon
/
mon_tokenizer
like
1
Mon
sentencepiece
tokenizer
mon
myanmar
nlp
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
mon_tokenizer
/
.gitignore
Commit History
feat: restructure and upgrade to 32k vocab model (v2)
e909ce1
janakhpon
commited on
Apr 26
feat: simplified mon tokenizer in hf format, updated tags
bece7ec
janakhpon
commited on
Aug 30, 2025
feat: simplified mon tokenizer in hf format
2ded9d3
janakhpon
commited on
Aug 30, 2025