metadata

license: llama2
language:
  - en
pipeline_tag: text-generation
inference: false
tags:
  - dare
  - super mario merge
  - pytorch
  - llama
  - codellama
  - merge

codellama 34b mega merge

The following were merged with DARE using https://github.com/martyn/safetensors-merge-supermario

Mergelist

codellama/CodeLlama-34b-hf
codellama/CodeLlama-34b-Instruct-hf
allenai/codetulu-2-34b
Phind/Phind-CodeLlama-34B-v1
Phind/Phind-CodeLlama-34B-Python-v1
uukuguy/speechless-codellama-34b-v2.0
codellama/CodeLlama-34b-Python-hf
Phind/Phind-CodeLlama-34B-v2

These models failed to merge:

pharaouk/unnatural_codellama_34B
codefuse-ai/CodeFuse-CodeLlama-34B
XAgentTeam/XAgentLLaMa-34B-preview

Merge command

python3 hf_merge.py codellama.txt codellama -p 0.16 -lambda 2