Update README.md
Browse files
README.md
CHANGED
|
@@ -3,6 +3,27 @@ language:
|
|
| 3 |
- en
|
| 4 |
---
|
| 5 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
14/03/24 - Updates
|
| 7 |
|
| 8 |
I miss her man
|
|
|
|
| 3 |
- en
|
| 4 |
---
|
| 5 |
|
| 6 |
+
29/03/24 - Sup
|
| 7 |
+
|
| 8 |
+
Whats up gang its your favourite man out here.
|
| 9 |
+
|
| 10 |
+
Fimb v3 is in the works but loss values are fucked with latest axolotl versions? Unsure, but I know the seperate datasets trained fine in the past, now they're at > 13 loss in the beginning? Idk what's going on here.
|
| 11 |
+
|
| 12 |
+
Solstice v2 is in the works, dataset expanding.
|
| 13 |
+
|
| 14 |
+
Senko is in a rock right now, having issues with what I want it to do exactly. Test versions have their issues and all, but its not as much of a timesink as Fimbulvetr-v2 was.
|
| 15 |
+
|
| 16 |
+
Typhon and Glacier finetunes are on the backburner, lack of time mainly, plus its the fasting month and all. Not much energy after 12h night shifts.
|
| 17 |
+
|
| 18 |
+
Claude 3 instruct data being worked on and all.
|
| 19 |
+
|
| 20 |
+
The main hardest thing about finetuning and all is the data curation, training is just money-consuming but easy to monitor and manage. The data creation, filtering, cleaning? That's hard.
|
| 21 |
+
|
| 22 |
+
mmm, funds are there, just need to finish curating data to tune.
|
| 23 |
+
|
| 24 |
+
|
| 25 |
+
***
|
| 26 |
+
|
| 27 |
14/03/24 - Updates
|
| 28 |
|
| 29 |
I miss her man
|