AnimeSai / tokenizer_2

Commit History

Rename vocab.json to tokenizer_2/vocab.json
cf647b4
verified

pranavajay commited on

Rename tokenizer_config.json to tokenizer_2/tokenizer_config.json
733f99f
verified

pranavajay commited on

Rename special_tokens_map.json to tokenizer_2/special_tokens_map.json
bbfb061
verified

pranavajay commited on

Rename merges.txt to tokenizer_2/merges.txt
6f76aa7
verified

pranavajay commited on