bge-large-gist-merge

bge-large-gist-merge is a merge of the following models using mergekit:

• BAAI/bge-large-en-v1.5
• avsolatorio/GIST-large-Embedding-v0

Configuration

models:

  - model: BAAI/bge-large-en-v1.5
    # No parameters necessary for base model

  - model: avsolatorio/GIST-large-Embedding-v0
    parameters:
      density: 0.5
      weight: 0.6

merge_method: dare_ties

base_model: 
  model: BAAI/bge-large-en-v1.5

parameters:
  int8_mask: true

dtype: bfloat16