Hugging Face's logo

Sourabh1407
/
gemma-2b-it-finetuned-dolly

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
Sourabh1407 commited on
Commit
4f40a4d
•
1 Parent(s): 2fdb8a0

End of training

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -41,7 +41,7 @@ The following hyperparameters were used during training:
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: cosine
44
- - training_steps: 500
45
  - mixed_precision_training: Native AMP
46
 
47
  ### Training results
@@ -52,6 +52,6 @@ The following hyperparameters were used during training:
52
 
53
  - PEFT 0.10.0
54
  - Transformers 4.40.1
55
- - Pytorch 2.3.0+cu121
56
  - Datasets 2.19.1
57
  - Tokenizers 0.19.1
 
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: cosine
44
+ - training_steps: 5000
45
  - mixed_precision_training: Native AMP
46
 
47
  ### Training results
 
52
 
53
  - PEFT 0.10.0
54
  - Transformers 4.40.1
55
+ - Pytorch 2.2.1+cu121
56
  - Datasets 2.19.1
57
  - Tokenizers 0.19.1