bengisucam
/

tr_tokenizer

Model card Files Files and versions Community

bengisucam commited on Dec 1, 2023

Commit

97e618a

•

1 Parent(s): 6e417ac

Update README.md

Llama-2 tokenizer with vocab size 50000

Files changed (1) hide show

README.md +6 -2

README.md CHANGED Viewed

@@ -1,4 +1,8 @@
 ---
 license: apache-2.0
----

 ---
 license: apache-2.0
+datasets:
+- bengisucam/tr_dataset_combined
+language:
+- tr
+pipeline_tag: token-classification
+---