Lewdiculous's picture
Update README.md
7bb3b8d verified
|
raw
history blame
No virus
1.56 kB
---
base_model:
- ChaoticNeutrals/BuRP_7B
- Endevor/InfinityRP-v1-7B
library_name: transformers
tags:
- mergekit
- merge
license: other
inference: false
language:
- en
---
This repository hosts GGUF-IQ-Imatrix quants for [jeiku/InfiniteBuRP_7B](https://huggingface.co/jeiku/InfiniteBuRP_7B).
Thanks @jeiku for merging this!
This is an experimental model. Feedback is appreciated as always.
**Steps:**
```
Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
```
*Using the latest llama.cpp at the time.*
```python
quantization_options = [
"Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
"Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
]
```
---
# BuRPInfinity_9B
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/626dfb8786671a29c715f8a9/l8WTAhHEV-SKQ8_BZs_ZH.jpeg)
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the passthrough merge method.
### Models Merged
The following models were included in the merge:
* [ChaoticNeutrals/BuRP_7B](https://huggingface.co/ChaoticNeutrals/BuRP_7B)
* [Endevor/InfinityRP-v1-7B](https://huggingface.co/Endevor/InfinityRP-v1-7B)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
slices:
- sources:
- model: Endevor/InfinityRP-v1-7B
layer_range: [0, 20]
- sources:
- model: ChaoticNeutrals/BuRP_7B
layer_range: [12, 32]
merge_method: passthrough
dtype: float16
```