TOP MODELS
Collection
52 items
β’
Updated
β’
2
UNDER DEVELOPMENT
[
https://github.com/spydaz
This model is being constantly retuned and updated ! (these updates may not be reflected in the current gguf!)
This is a highly focused model which is dedicated to producing code and functions and applications. It has been erged with the top models of this repo and will be fine tuned on datasets dedicated to coding problems and other code related tasks. such as uml diagrams and object oriented planning etc.
This is a merge of pre-trained language models created using mergekit.
This model was merged using the TIES merge method using LeroyDyer/Mixtral_AI_Cyber_3.0 as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: LeroyDyer/Mixtral_AI_Multi_TEST
parameters:
density: [0.87, 0.721, 0.451] # density gradient
weight: 0.876
- model: LeroyDyer/Mixtral_AI_MultiToken
parameters:
density: 0.232
weight: [0.36, 0.3, 0.437, 0.76] # weight gradient
- model: mistralai/Mistral-7B-Instruct-v0.2
parameters:
density: 0.475
weight:
- filter: mlp
value: 0.5
- value: 0
merge_method: ties
base_model: LeroyDyer/Mixtral_AI_Cyber_3.0
parameters:
normalize: true
int8_mask: true
dtype: float16