jaygala24 commited on
Commit
81f25f3
1 Parent(s): 20ac2c1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -41,7 +41,7 @@ We fine-tune OpenHathi base model on the aforementioned IndicInstruct dataset wi
41
  - LoRA Rank: 16
42
  - LoRA alpha: 32
43
  - LoRA Dropout: 0.05
44
- - LoRA Target Modules: ["q_proj", "v_proj", "down_proj", "gate_proj", "up_proj", "k_proj"]
45
  - Epochs: 4
46
  - Learning rate: 5e-4
47
  - Batch Size: 128
 
41
  - LoRA Rank: 16
42
  - LoRA alpha: 32
43
  - LoRA Dropout: 0.05
44
+ - LoRA Target Modules: ["q_proj", "v_proj", "k_proj", "o_proj", "down_proj", "gate_proj", "up_proj"]
45
  - Epochs: 4
46
  - Learning rate: 5e-4
47
  - Batch Size: 128