lgessler commited on
Commit
de28347
1 Parent(s): 072a18c

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: mlt
3
+ widget:
4
+ - text: Hu rrifjuta l-akkużi li l-Gvern Malti qed jimxi bi djufija.
5
+ ---
6
+
7
+ This is a [MicroBERT](https://github.com/lgessler/microbert) model for Maltese.
8
+
9
+ * Its suffix is **-mxp**, which means that it was pretrained using supervision from masked language modeling, XPOS tagging, and UD dependency parsing.
10
+ * The unlabeled Maltese data was taken from a February 2022 dump of Maltese Wikipedia, totaling 2,113,223 tokens.
11
+ * The UD treebank [UD_Maltese-GSD](https://github.com/UniversalDependencies/UD_Maltese-MUDT), v2.9, totaling 44,162 tokens, was used for labeled data.
12
+
13
+ Please see [the repository](https://github.com/lgessler/microbert) and
14
+ [the paper](https://github.com/lgessler/microbert/raw/master/MicroBERT__MRL_2022_.pdf) for more details.
15
+