File size: 1,032 Bytes
3b34ad7 c0551ca 0082195 3b34ad7 c0551ca |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 |
---
license: llama2
language:
- en
pipeline_tag: text-generation
inference: false
tags:
- dare
- super mario merge
- pytorch
- llama
- llama-2
- merge
---
# llama 13b mega merge v2
The following were merged with DARE using [https://github.com/martyn/safetensors-merge-supermario](https://github.com/martyn/safetensors-merge-supermario)
## Mergelist
```
meta-llama/Llama-2-13b-hf
ajibawa-2023/Code-13B
ajibawa-2023/Python-Code-13B
meta-math/MetaMath-13B-V1.0
rombodawg/LosslessMegaCoder-llama2-13b-mini
NousResearch/Nous-Hermes-Llama2-13b
allenai/digital-socrates-13b
migtissera/Synthia-13B
Gryphe/MythoLogic-L2-13b
allenai/tulu-2-dpo-13b
FPHam/Free_Sydney_13b_HF
FPHam/Free_Sydney_V2_13b_HF
FPHam/Sydney_Overthinker_13b_HF
KoboldAI/LLaMA2-13B-Psyfighter2
Undi95/Unholy-v1-12L-13B
athirdpath/Eileithyia-13B
athirdpath/Orca-2-13b-Alpaca-Uncensored
```
## Merge command
```
python hf_merge.py mergelist.txt 13b-merge-v2 -p 0.11 -lambda 2.1
```
## Notes
* seems to generalize instruct styles
* `p` and `lambda` are still a guess |