Liu Hong Yuan Tom
commited on
Commit
•
0124352
1
Parent(s):
45cdaa8
Update README.md
Browse files
README.md
CHANGED
|
@@ -24,7 +24,7 @@ This gemma2 model was trained 2x faster with [Unsloth](https://github.com/unslot
|
|
| 24 |
|
| 25 |
# Details
|
| 26 |
|
| 27 |
-
This model is fine tuned from unsloth/gemma-2-9b-bnb-4bit on the alpaca-cleaned dataset using the **
|
| 28 |
|
| 29 |
This model achieved a loss of 0.817200 on the alpaca-cleaned dataset after step 120.
|
| 30 |
|
|
|
|
| 24 |
|
| 25 |
# Details
|
| 26 |
|
| 27 |
+
This model is fine tuned from unsloth/gemma-2-9b-bnb-4bit on the alpaca-cleaned dataset using the **QDoRA** method.
|
| 28 |
|
| 29 |
This model achieved a loss of 0.817200 on the alpaca-cleaned dataset after step 120.
|
| 30 |
|