CooperW
/

Phi_3_5_mini_instruct_bnb_4bit_128Batch

Model card Files Files and versions Metrics Training metrics Community

CooperW commited on 9 days ago

Commit

d578345

•

1 Parent(s): be71e5a

Update README.md

Files changed (1) hide show

README.md +7 -1

README.md CHANGED Viewed

@@ -14,4 +14,10 @@ Key Training Params:
   * Batch Size: 128
   * Optimizer: Adam_8bit
   * lr_schedular: cosine_with_restarts
-  * lr_scheduler_kwargs = { "num_cycles": len(trainer.get_train_dataloader()) / 100 }

   * Batch Size: 128
   * Optimizer: Adam_8bit
   * lr_schedular: cosine_with_restarts
+  * lr_scheduler_kwargs = { "num_cycles": len(trainer.get_train_dataloader()) / 100 }
+Train Dataset:
+  * network_train.jsonl
+Test Dataset:
+  * network_test.jsonl