README.md

metadata

base_model: NeuralNovel/Mini-Mixtral-v0.2
inference: false
license: apache-2.0
merged_models:
  - unsloth/mistral-7b-v0.2
  - mistralai/Mistral-7B-Instruct-v0.2
pipeline_tag: text-generation
quantized_by: Suparious
tags:
  - moe
  - frankenmoe
  - merge
  - mergekit
  - lazymergekit
  - unsloth/mistral-7b-v0.2
  - mistralai/Mistral-7B-Instruct-v0.2
  - quantized
  - 4-bit
  - AWQ
  - text-generation
  - autotrain_compatible
  - endpoints_compatible
  - chatml

NeuralNovel/Mini-Mixtral-v0.2 AWQ

• Model creator: NeuralNovel
• Original model: Mini-Mixtral-v0.2

Model Summary

Mini-Mixtral-v0.2 is a Mixture of Experts (MoE) made with the following models using LazyMergekit:

• unsloth/mistral-7b-v0.2
• mistralai/Mistral-7B-Instruct-v0.2