nlpie
/

bio-distilbert-uncased

Inference Endpoints

Model card Files Files and versions Community

mohammadmahdinouri commited on Nov 4, 2022

Commit

fb75013

•

1 Parent(s): ce83ed4

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ BioDistilBERT-uncased is the result of training the [DistilBERT-uncased](https:/
 We initialise our model with the pre-trained checkpoints of the [DistilBERT-uncased](https://huggingface.co/distilbert-base-uncased?text=The+goal+of+life+is+%5BMASK%5D.) model available on the Huggingface.
 # Architecture
-In this model, the size of the hidden dimension and the embedding layer are both set to 768. The vocabulary size is 28996. The number of transformer layers is 6 and the expansion rate of the feed-forward layer is 4. Overall this model has around 65 million parameters.
 # Citation
 If you use this model, please consider citing the following paper:

 We initialise our model with the pre-trained checkpoints of the [DistilBERT-uncased](https://huggingface.co/distilbert-base-uncased?text=The+goal+of+life+is+%5BMASK%5D.) model available on the Huggingface.
 # Architecture
+In this model, the size of the hidden dimension and the embedding layer are both set to 768. The vocabulary size is 30522. The number of transformer layers is 6 and the expansion rate of the feed-forward layer is 4. Overall this model has around 65 million parameters.
 # Citation
 If you use this model, please consider citing the following paper: