nguyennghia0902 commited on
Commit
fd9bb92
1 Parent(s): 1146e1e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -16
README.md CHANGED
@@ -21,36 +21,29 @@ It achieves the following results on the evaluation set:
21
  - Train Accuracy: 0.7976
22
  - Validation Loss: 0.5521
23
  - Validation Accuracy: 0.7456
24
- - Epoch: 4
 
25
 
26
  ## Model description
27
- This model is fine-tuned by Bùi Nguyên Nghĩa - 19120600@student.hcmus.edu.vn in [Kaggle](https://www.kaggle.com/code/nguynnghabi/training-electra)
28
-
29
- ## Intended uses & limitations
30
-
31
- More information needed
32
-
33
- ## Training and evaluation data
34
-
35
- More information needed
36
 
37
  ## Training procedure
38
 
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
- - optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': 5e-05, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
43
  - training_precision: float32
44
 
45
  ### Training results
46
 
47
  | Train Loss | Train Accuracy | Validation Loss | Validation Accuracy | Epoch |
48
  |:----------:|:--------------:|:---------------:|:-------------------:|:-----:|
49
- | 0.5951 | 0.6936 | 0.5818 | 0.6966 | 0 |
50
- | 0.5484 | 0.7291 | 0.5681 | 0.7054 | 1 |
51
- | 0.5119 | 0.7543 | 0.5284 | 0.7423 | 2 |
52
- | 0.4769 | 0.7800 | 0.5306 | 0.7432 | 3 |
53
- | 0.4494 | 0.7976 | 0.5521 | 0.7456 | 4 |
54
 
55
 
56
  ### Framework versions
 
21
  - Train Accuracy: 0.7976
22
  - Validation Loss: 0.5521
23
  - Validation Accuracy: 0.7456
24
+ - Epoch: 5
25
+ - Batch size: 32
26
 
27
  ## Model description
28
+ This model is fine-tuned by 19120600@student.hcmus.edu.vn in [Kaggle](https://www.kaggle.com/code/nguynnghabi/training-electra)
 
 
 
 
 
 
 
 
29
 
30
  ## Training procedure
31
 
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
+ - optimizer: {'name': 'Adam', 'learning_rate': 5e-05, 'epsilon': 1e-08}
36
  - training_precision: float32
37
 
38
  ### Training results
39
 
40
  | Train Loss | Train Accuracy | Validation Loss | Validation Accuracy | Epoch |
41
  |:----------:|:--------------:|:---------------:|:-------------------:|:-----:|
42
+ | 0.5951 | 0.6936 | 0.5818 | 0.6966 | 1 |
43
+ | 0.5484 | 0.7291 | 0.5681 | 0.7054 | 2 |
44
+ | 0.5119 | 0.7543 | 0.5284 | 0.7423 | 3 |
45
+ | 0.4769 | 0.7800 | 0.5306 | 0.7432 | 4 |
46
+ | 0.4494 | 0.7976 | 0.5521 | 0.7456 | 5 |
47
 
48
 
49
  ### Framework versions