--- base_model: - bunnycore/Qwen-2.5-7b-TitanFusion-v2 - bunnycore/Qwen-2.5-7b-TitanFusion-v2 - bunnycore/Qwen-2.5-7b-rp-lora - Orion-zhen/Qwen2.5-7B-Instruct-Uncensored - bunnycore/Qwen-2.5-7b-rp-lora library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [bunnycore/Qwen-2.5-7b-TitanFusion-v2](https://huggingface.co/bunnycore/Qwen-2.5-7b-TitanFusion-v2) as a base. ### Models Merged The following models were included in the merge: * [bunnycore/Qwen-2.5-7b-TitanFusion-v2](https://huggingface.co/bunnycore/Qwen-2.5-7b-TitanFusion-v2) + [bunnycore/Qwen-2.5-7b-rp-lora](https://huggingface.co/bunnycore/Qwen-2.5-7b-rp-lora) * [Orion-zhen/Qwen2.5-7B-Instruct-Uncensored](https://huggingface.co/Orion-zhen/Qwen2.5-7B-Instruct-Uncensored) + [bunnycore/Qwen-2.5-7b-rp-lora](https://huggingface.co/bunnycore/Qwen-2.5-7b-rp-lora) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: bunnycore/Qwen-2.5-7b-TitanFusion-v2+bunnycore/Qwen-2.5-7b-rp-lora - model: Orion-zhen/Qwen2.5-7B-Instruct-Uncensored+bunnycore/Qwen-2.5-7b-rp-lora - model: bunnycore/Qwen-2.5-7b-TitanFusion-v2+bunnycore/Qwen-2.5-7b-rp-lora merge_method: model_stock base_model: bunnycore/Qwen-2.5-7b-TitanFusion-v2 dtype: bfloat16 ```