Mistral 7B Zephyr SFT V2
The Zephyr SFT recipe applied on top of Mistral 7B (new recipe with chatML format)
Model description
- Model type: A 7.2B parameter GPT-like model fine-tuned on a mix of publicly available, synthetic datasets.
- Language(s) (NLP): Primarily English
- Finetuned from model: mistralai/Mistral-7B-v0.1
Recipe
We trained using the alignment handbook recipe and logging to W&B
Visit the W&B workspace here
Compute provided by Lambda Labs - 8xA100 80GB node
- Downloads last month
- 61
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.