v000000/SyntheticMoist-11B

RP Model, Experimental Solar merge. Alpaca/Vicuna format.

Thanks mradermacher for the quants

• GGUF
• GGUF imatrix

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using upstage/SOLAR-10.7B-v1.0 as a base.

Models Merged

The following models were included in the merge:

• Himitsui/Kaiju-11B
• TheDrummer/Moistral-11B-v3
• Himitsui/MedMitsu-Instruct-11B
• migtissera/Synthia-v3.0-11B

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Himitsui/MedMitsu-Instruct-11B
    parameters:
      weight: 0.16
      density: 0.42
  - model: Himitsui/Kaiju-11B
    parameters:
      weight: 0.22
      density: 0.54
  - model: migtissera/Synthia-v3.0-11B
    parameters:
      weight: 0.28
      density: 0.66
  - model: TheDrummer/Moistral-11B-v3
    parameters:
      weight: 0.34
      density: 0.78
merge_method: dare_ties
base_model: upstage/SOLAR-10.7B-v1.0
parameters:
  int8_mask: true
dtype: bfloat16