huawei-noah/AT5B

Overview

AT5B is an Arabic T5-base model. It's is only compatible with the code in this github repo (not supported by the Transformers library)

Citation

Please cite the following paper when using our code and model:

@article{ghaddar2022revisiting,
  title={Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding},
  author={Ghaddar, Abbas and Wu, Yimeng and Bagga, Sunyam and Rashid, Ahmad and Bibi, Khalil and Rezagholizadeh, Mehdi and Xing, Chao and Wang, Yasheng and Xinyu, Duan and Wang, Zhefeng and others},
  journal={arXiv preprint arXiv:2205.10687},
  year={2022}
}