Update README.md
Browse files
README.md
CHANGED
|
@@ -49,7 +49,7 @@ Trained [Qwen2.5-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-14B-Instruct)
|
|
| 49 |
|
| 50 |
* Merged with a sophosympatheia's <b>SLERP</b> gradient *"Qwen2.5-14B-Instruct"* and *"Gutenberg DPO"*
|
| 51 |
|
| 52 |
-
* Merged all <b>DPO checkpoints</b> and <b>SLERP</b> variations with <b>MODEL_STOCK</b> to analyze geometric properties and get the most performant aspects of all runs/merges.
|
| 53 |
|
| 54 |
## Recipe
|
| 55 |
|
|
|
|
| 49 |
|
| 50 |
* Merged with a sophosympatheia's <b>SLERP</b> gradient *"Qwen2.5-14B-Instruct"* and *"Gutenberg DPO"*
|
| 51 |
|
| 52 |
+
* Merged all <b>DPO checkpoints</b> and <b>SLERP</b> variations with <b>MODEL_STOCK</b> to analyze geometric properties and get the most performant aspects of all runs/merges. Model Stock was chosen due to the similarity between the merged models.
|
| 53 |
|
| 54 |
## Recipe
|
| 55 |
|