Ksgk-fy commited on
Commit
f522ef8
1 Parent(s): 4d21f77

Model save

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -36,15 +36,15 @@ More information needed
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 0.0002
39
- - train_batch_size: 3
40
  - eval_batch_size: 8
41
  - seed: 42
42
  - gradient_accumulation_steps: 2
43
- - total_train_batch_size: 6
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: constant
46
  - lr_scheduler_warmup_ratio: 0.03
47
- - num_epochs: 3
48
 
49
  ### Training results
50
 
@@ -52,8 +52,8 @@ The following hyperparameters were used during training:
52
 
53
  ### Framework versions
54
 
55
- - PEFT 0.10.0
56
- - Transformers 4.39.1
57
- - Pytorch 2.2.1+cu121
58
- - Datasets 2.18.0
59
- - Tokenizers 0.15.2
 
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 0.0002
39
+ - train_batch_size: 16
40
  - eval_batch_size: 8
41
  - seed: 42
42
  - gradient_accumulation_steps: 2
43
+ - total_train_batch_size: 32
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: constant
46
  - lr_scheduler_warmup_ratio: 0.03
47
+ - num_epochs: 10
48
 
49
  ### Training results
50
 
 
52
 
53
  ### Framework versions
54
 
55
+ - PEFT 0.8.2
56
+ - Transformers 4.38.0.dev0
57
+ - Pytorch 2.1.2+cu121
58
+ - Datasets 2.17.0
59
+ - Tokenizers 0.15.0