Alex034/t5-base-finetuned-summary

This model is a fine-tuned version of t5-base on an unknown dataset. It achieves the following results on the evaluation set:

• Train Loss: 1.0271
• Validation Loss: 1.0757
• Train Rouge1: 19.0533
• Train Rouge2: 11.1741
• Train Rougel: 17.8728
• Train Rougelsum: 18.4536
• Train Gen Len: 19.0
• Epoch: 8

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
• training_precision: float32

Training results

Train Loss	Validation Loss	Train Rouge1	Train Rouge2	Train Rougel	Train Rougelsum	Train Gen Len	Epoch
1.3902	1.2441	18.3117	10.6041	17.2628	17.7391	19.0	0
1.2550	1.1977	18.3266	10.5940	17.2537	17.7704	19.0	1
1.2009	1.1616	18.4395	10.6141	17.2987	17.8340	19.0	2
1.1585	1.1391	18.6576	10.9045	17.5763	18.0749	19.0	3
1.1260	1.1230	18.8069	11.0361	17.7010	18.2123	19.0	4
1.0944	1.1077	18.7422	10.9589	17.6239	18.1584	19.0	5
1.0703	1.1010	18.8101	10.9865	17.6687	18.2161	19.0	6
1.0486	1.0833	19.1833	11.2929	18.0132	18.5919	19.0	7
1.0271	1.0757	19.0533	11.1741	17.8728	18.4536	19.0	8

Framework versions

• Transformers 4.35.0
• TensorFlow 2.13.0
• Datasets 2.15.0
• Tokenizers 0.14.1