Hugging Face's logo

csujeong
/
Gemma-7B-Finetuning-JCS-Ko

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
csujeong commited on
Commit
6c3d7e5
•
1 Parent(s): 75ed7a0

Training in progress, step 60

Browse files
Files changed (5) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Feb26_12-56-13_28abd6843fb6/events.out.tfevents.1708952191.28abd6843fb6.678.0 +2 -2
  3. wandb/debug-internal.log +47 -0
  4. wandb/run-20240226_125646-ilpu1hh1/files/wandb-summary.json +1 -1
  5. wandb/run-20240226_125646-ilpu1hh1/logs/debug-internal.log +47 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:72d5c7abefce14f4f675e5684c079a803f331d845a28a01fb140eb1819f7cc62
3
  size 201888736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:149a5175a496a413b00a66a20111535bf9f6849d0e6a4cd5e1e443a2545aa99b
3
  size 201888736
runs/Feb26_12-56-13_28abd6843fb6/events.out.tfevents.1708952191.28abd6843fb6.678.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ceb7bbed6e046d017579b0127899bfdae565c03ac5158662db980afc6d0b03dc
3
- size 21386
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77054105e2503372187391de3cfc44eb9a0c36e1c997786bda25180a5f1fc53f
3
+ size 21941
wandb/debug-internal.log CHANGED
@@ -609,3 +609,50 @@
609
  2024-02-26 13:12:07,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
610
  2024-02-26 13:12:07,739 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
611
  2024-02-26 13:12:11,065 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
609
  2024-02-26 13:12:07,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
610
  2024-02-26 13:12:07,739 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
611
  2024-02-26 13:12:11,065 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
612
+ 2024-02-26 13:12:16,066 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
613
+ 2024-02-26 13:12:21,067 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
614
+ 2024-02-26 13:12:22,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: internal_messages
615
+ 2024-02-26 13:12:22,739 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
616
+ 2024-02-26 13:12:22,739 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
617
+ 2024-02-26 13:12:23,042 DEBUG SenderThread:3250 [sender.py:send():382] send: stats
618
+ 2024-02-26 13:12:27,043 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
619
+ 2024-02-26 13:12:32,045 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
620
+ 2024-02-26 13:12:37,046 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
621
+ 2024-02-26 13:12:37,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: internal_messages
622
+ 2024-02-26 13:12:37,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
623
+ 2024-02-26 13:12:37,739 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
624
+ 2024-02-26 13:12:42,082 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
625
+ 2024-02-26 13:12:47,083 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
626
+ 2024-02-26 13:12:52,084 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
627
+ 2024-02-26 13:12:52,737 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: internal_messages
628
+ 2024-02-26 13:12:52,743 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
629
+ 2024-02-26 13:12:52,743 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
630
+ 2024-02-26 13:12:53,063 DEBUG SenderThread:3250 [sender.py:send():382] send: stats
631
+ 2024-02-26 13:12:58,071 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
632
+ 2024-02-26 13:12:59,657 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: partial_history
633
+ 2024-02-26 13:12:59,659 DEBUG SenderThread:3250 [sender.py:send():382] send: history
634
+ 2024-02-26 13:12:59,659 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: summary_record
635
+ 2024-02-26 13:12:59,674 INFO SenderThread:3250 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
636
+ 2024-02-26 13:13:00,631 INFO Thread-12 :3250 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko/wandb/run-20240226_125646-ilpu1hh1/files/wandb-summary.json
637
+ 2024-02-26 13:13:03,678 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
638
+ 2024-02-26 13:13:05,424 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: partial_history
639
+ 2024-02-26 13:13:05,427 DEBUG SenderThread:3250 [sender.py:send():382] send: metric
640
+ 2024-02-26 13:13:05,428 DEBUG SenderThread:3250 [sender.py:send():382] send: metric
641
+ 2024-02-26 13:13:05,434 DEBUG SenderThread:3250 [sender.py:send():382] send: metric
642
+ 2024-02-26 13:13:05,436 DEBUG SenderThread:3250 [sender.py:send():382] send: metric
643
+ 2024-02-26 13:13:05,436 DEBUG SenderThread:3250 [sender.py:send():382] send: metric
644
+ 2024-02-26 13:13:05,436 DEBUG SenderThread:3250 [sender.py:send():382] send: history
645
+ 2024-02-26 13:13:05,438 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: summary_record
646
+ 2024-02-26 13:13:05,446 INFO SenderThread:3250 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
647
+ 2024-02-26 13:13:05,644 INFO Thread-12 :3250 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko/wandb/run-20240226_125646-ilpu1hh1/files/wandb-summary.json
648
+ 2024-02-26 13:13:07,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: internal_messages
649
+ 2024-02-26 13:13:07,739 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
650
+ 2024-02-26 13:13:07,740 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
651
+ 2024-02-26 13:13:08,985 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
652
+ 2024-02-26 13:13:13,986 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
653
+ 2024-02-26 13:13:18,987 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
654
+ 2024-02-26 13:13:22,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: internal_messages
655
+ 2024-02-26 13:13:22,739 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
656
+ 2024-02-26 13:13:22,739 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
657
+ 2024-02-26 13:13:23,044 DEBUG SenderThread:3250 [sender.py:send():382] send: stats
658
+ 2024-02-26 13:13:24,044 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240226_125646-ilpu1hh1/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 3.3303, "train/grad_norm": 11.1882905960083, "train/learning_rate": 1.4314282383241096e-05, "train/epoch": 0.01, "train/global_step": 50, "_timestamp": 1708953112.064011, "_runtime": 905.1986742019653, "_step": 4}
 
1
+ {"train/loss": 2.5767, "train/grad_norm": 8.225747108459473, "train/learning_rate": 0.0, "train/epoch": 0.01, "train/global_step": 60, "_timestamp": 1708953185.4240155, "_runtime": 978.5586786270142, "_step": 6, "train/train_runtime": 311.2367, "train/train_samples_per_second": 0.386, "train/train_steps_per_second": 0.193, "train/total_flos": 265648280524800.0, "train/train_loss": 2.8566620190938314}
wandb/run-20240226_125646-ilpu1hh1/logs/debug-internal.log CHANGED
@@ -609,3 +609,50 @@
609
  2024-02-26 13:12:07,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
610
  2024-02-26 13:12:07,739 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
611
  2024-02-26 13:12:11,065 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
609
  2024-02-26 13:12:07,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
610
  2024-02-26 13:12:07,739 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
611
  2024-02-26 13:12:11,065 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
612
+ 2024-02-26 13:12:16,066 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
613
+ 2024-02-26 13:12:21,067 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
614
+ 2024-02-26 13:12:22,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: internal_messages
615
+ 2024-02-26 13:12:22,739 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
616
+ 2024-02-26 13:12:22,739 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
617
+ 2024-02-26 13:12:23,042 DEBUG SenderThread:3250 [sender.py:send():382] send: stats
618
+ 2024-02-26 13:12:27,043 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
619
+ 2024-02-26 13:12:32,045 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
620
+ 2024-02-26 13:12:37,046 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
621
+ 2024-02-26 13:12:37,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: internal_messages
622
+ 2024-02-26 13:12:37,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
623
+ 2024-02-26 13:12:37,739 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
624
+ 2024-02-26 13:12:42,082 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
625
+ 2024-02-26 13:12:47,083 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
626
+ 2024-02-26 13:12:52,084 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
627
+ 2024-02-26 13:12:52,737 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: internal_messages
628
+ 2024-02-26 13:12:52,743 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
629
+ 2024-02-26 13:12:52,743 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
630
+ 2024-02-26 13:12:53,063 DEBUG SenderThread:3250 [sender.py:send():382] send: stats
631
+ 2024-02-26 13:12:58,071 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
632
+ 2024-02-26 13:12:59,657 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: partial_history
633
+ 2024-02-26 13:12:59,659 DEBUG SenderThread:3250 [sender.py:send():382] send: history
634
+ 2024-02-26 13:12:59,659 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: summary_record
635
+ 2024-02-26 13:12:59,674 INFO SenderThread:3250 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
636
+ 2024-02-26 13:13:00,631 INFO Thread-12 :3250 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko/wandb/run-20240226_125646-ilpu1hh1/files/wandb-summary.json
637
+ 2024-02-26 13:13:03,678 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
638
+ 2024-02-26 13:13:05,424 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: partial_history
639
+ 2024-02-26 13:13:05,427 DEBUG SenderThread:3250 [sender.py:send():382] send: metric
640
+ 2024-02-26 13:13:05,428 DEBUG SenderThread:3250 [sender.py:send():382] send: metric
641
+ 2024-02-26 13:13:05,434 DEBUG SenderThread:3250 [sender.py:send():382] send: metric
642
+ 2024-02-26 13:13:05,436 DEBUG SenderThread:3250 [sender.py:send():382] send: metric
643
+ 2024-02-26 13:13:05,436 DEBUG SenderThread:3250 [sender.py:send():382] send: metric
644
+ 2024-02-26 13:13:05,436 DEBUG SenderThread:3250 [sender.py:send():382] send: history
645
+ 2024-02-26 13:13:05,438 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: summary_record
646
+ 2024-02-26 13:13:05,446 INFO SenderThread:3250 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
647
+ 2024-02-26 13:13:05,644 INFO Thread-12 :3250 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko/wandb/run-20240226_125646-ilpu1hh1/files/wandb-summary.json
648
+ 2024-02-26 13:13:07,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: internal_messages
649
+ 2024-02-26 13:13:07,739 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
650
+ 2024-02-26 13:13:07,740 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
651
+ 2024-02-26 13:13:08,985 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
652
+ 2024-02-26 13:13:13,986 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
653
+ 2024-02-26 13:13:18,987 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report
654
+ 2024-02-26 13:13:22,738 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: internal_messages
655
+ 2024-02-26 13:13:22,739 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: stop_status
656
+ 2024-02-26 13:13:22,739 DEBUG SenderThread:3250 [sender.py:send_request():409] send_request: stop_status
657
+ 2024-02-26 13:13:23,044 DEBUG SenderThread:3250 [sender.py:send():382] send: stats
658
+ 2024-02-26 13:13:24,044 DEBUG HandlerThread:3250 [handler.py:handle_request():146] handle_request: status_report