azma-phi-2-instruct-structured

README.md

@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [microsoft/phi-2](https://huggingface.co/microsoft/phi-2) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.8902
+- Loss: 0.8575
 
 ## Model description
 
@@ -45,27 +45,16 @@ The following hyperparameters were used during training:
 - lr_scheduler_type: constant
 - lr_scheduler_warmup_ratio: 0.03
 - lr_scheduler_warmup_steps: 150
-- num_epochs: 0.5
+- num_epochs: 0.1
 - mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 0.7893        | 0.04  | 25   | 0.9209          |
-| 0.7162        | 0.07  | 50   | 0.9266          |
-| 0.9178        | 0.11  | 75   | 0.8747          |
-| 0.7546        | 0.14  | 100  | 0.8973          |
-| 0.8387        | 0.18  | 125  | 0.8814          |
-| 0.7346        | 0.21  | 150  | 0.8926          |
-| 0.8609        | 0.25  | 175  | 0.8971          |
-| 0.7118        | 0.29  | 200  | 0.8833          |
-| 0.8248        | 0.32  | 225  | 0.8747          |
-| 0.6511        | 0.36  | 250  | 0.8852          |
-| 0.9178        | 0.39  | 275  | 0.8744          |
-| 0.6139        | 0.43  | 300  | 0.8885          |
-| 0.8795        | 0.46  | 325  | 0.8802          |
-| 0.5775        | 0.5   | 350  | 0.8902          |
+| 0.6839        | 0.03  | 25   | 0.9049          |
+| 0.7678        | 0.06  | 50   | 0.8707          |
+| 0.8489        | 0.09  | 75   | 0.8575          |
 
 
 ### Framework versions

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:246fb6856247357cc0a249a0ea6e818314c39fb014098d33363c44b7dfecc8f3
+oid sha256:b657ca88b624f2eb3fb170180fec3e79e2ec2c79ac237b7fbd833db99710bd79
 size 1115659992