Commit
•
0f09075
1
Parent(s):
07e18df
Update README.md
Browse files
README.md
CHANGED
|
@@ -22,9 +22,13 @@ Thinking about finetuning on a RP dataset later on to direct the model more
|
|
| 22 |
### Model Sources [optional]
|
| 23 |
|
| 24 |
model_name: Lumosia-MoE-4x10.7
|
|
|
|
| 25 |
base_model: DopeorNope/SOLARC-M-10.7B
|
|
|
|
| 26 |
gate_mode: hidden
|
|
|
|
| 27 |
dtype: bfloat16
|
|
|
|
| 28 |
experts:
|
| 29 |
- source_model: DopeorNope/SOLARC-M-10.7B
|
| 30 |
positive_prompts: [""]
|
|
|
|
| 22 |
### Model Sources [optional]
|
| 23 |
|
| 24 |
model_name: Lumosia-MoE-4x10.7
|
| 25 |
+
|
| 26 |
base_model: DopeorNope/SOLARC-M-10.7B
|
| 27 |
+
|
| 28 |
gate_mode: hidden
|
| 29 |
+
|
| 30 |
dtype: bfloat16
|
| 31 |
+
|
| 32 |
experts:
|
| 33 |
- source_model: DopeorNope/SOLARC-M-10.7B
|
| 34 |
positive_prompts: [""]
|