Shekswess commited on
Commit
dc8d12b
1 Parent(s): efef757

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -4
README.md CHANGED
@@ -8,15 +8,29 @@ tags:
8
  - unsloth
9
  - llama
10
  - trl
 
11
  base_model: unsloth/llama-3-8b-Instruct-bnb-4bit
 
 
12
  ---
13
 
14
- # Uploaded model
15
-
16
  - **Developed by:** Shekswess
17
  - **License:** apache-2.0
18
  - **Finetuned from model :** unsloth/llama-3-8b-Instruct-bnb-4bit
19
 
20
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
8
  - unsloth
9
  - llama
10
  - trl
11
+ - medical
12
  base_model: unsloth/llama-3-8b-Instruct-bnb-4bit
13
+ datasets:
14
+ - Shekswess/medical_llama3_instruct_dataset_short
15
  ---
16
 
 
 
17
  - **Developed by:** Shekswess
18
  - **License:** apache-2.0
19
  - **Finetuned from model :** unsloth/llama-3-8b-Instruct-bnb-4bit
20
 
21
+ To utilize the fine-tuning of the model, you need to use the gemma instruction prompt template for this medical version of the model:
22
+ ```
23
+ <|start_header_id|>system<|end_header_id|> Answer the question truthfully, you are a medical professional.<|eot_id|><|start_header_id|>user<|end_header_id|> This is the question: {question}?<|eot_id|>
24
+ ```
25
+
26
+ Metrics:
27
+
28
+ - train_runtime: 2083.0086
29
+ - train_samples_per_second: 0.96
30
+ - train_steps_per_second: 0.12
31
+ - total_flos: 2.928942377774285e+16
32
+ - train_loss: 1.228120258331299
33
+ - steps: 250
34
+ - epoch: 1.0
35
 
36
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6569f13004643352df96e40f/bEsUnq3XmpUSCMdOG-Ur1.png)