Commit
•
3e5f7b6
1
Parent(s):
ad129df
Update README.md
Browse files
README.md
CHANGED
|
@@ -35,6 +35,22 @@ It achieves the following results on the evaluation set:
|
|
| 35 |
- Loss: 0.7724
|
| 36 |
- Accuracy: 0.9158
|
| 37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
## Model description
|
| 39 |
|
| 40 |
More information needed
|
|
|
|
| 35 |
- Loss: 0.7724
|
| 36 |
- Accuracy: 0.9158
|
| 37 |
|
| 38 |
+
## Model Training Details
|
| 39 |
+
|
| 40 |
+
| Parameter | Value |
|
| 41 |
+
|----------------------|--------------------------------------------------|
|
| 42 |
+
| **Task** | text-classification |
|
| 43 |
+
| **Teacher Model** | bert-base-uncased-finetuned-clinc_oos |
|
| 44 |
+
| **Student Model** | distilbert-base-uncased |
|
| 45 |
+
| **Dataset Name** | clinc_oos |
|
| 46 |
+
| **Dataset Config** | plus |
|
| 47 |
+
| **Evaluation Dataset**| validation |
|
| 48 |
+
| **Batch Size** | 48 |
|
| 49 |
+
| **Number of Epochs** | 5 |
|
| 50 |
+
| **Learning Rate** | 0.00002 |
|
| 51 |
+
| **Alpha*** | 1 |
|
| 52 |
+
*alpha: (Total_loss = alpha * Loss_CE + (1-alpha) * Loss_KD)
|
| 53 |
+
|
| 54 |
## Model description
|
| 55 |
|
| 56 |
More information needed
|