Spaces:

MohamedRashad
/

arabic-tokenizers-leaderboard

Running

App Files Files Community

arabic-tokenizers-leaderboard

Commit History

chore: Update leaderboard description and notes in app.py

8f88df6

Running

MohamedRashad commited on May 23

feat: Add Fertility Score calculation and Tokenize Tashkeel indicator to leaderboard description

d2eec13

MohamedRashad commited on May 23

refactor: improve tokenization for Arabic text

d2e2dfe

MohamedRashad commited on May 23

Add refresh functionality to update dataframe

0c0efc4

MohamedRashad commited on May 20

Update app.py

e4cac44
verified

MohamedRashad commited on May 17

Refactor tokenize_text function to include better tokenization for Arabic Text

a9aadc2

MohamedRashad commited on May 17

Add sentencepiece to requirements.txt

0384cfb

MohamedRashad commited on May 17

Refactor code and optimize dataframe sorting

6a52aab

MohamedRashad commited on May 17

Update tokenization and visualization logic

62d4a12

MohamedRashad commited on May 17

Add Arabic Tokenizers Leaderboard and Gradio Interface

203ba9b

MohamedRashad commited on May 17

initial commit

1af62ac
verified

MohamedRashad commited on Apr 23