Commit History
add tokenization process
24469e0
add balochi tokenizer
1380cef
process and clean files
b3db2b8
Get all text paths
470e696
add data folder to gitignore
c9036ae
add python gitignore
d1671f2
Initial commit
851cdf4
unverified
Alex Strick van Linschoten
commited on