Model Card for molbal/novelstral-7b
Short response, text completion model trained on various novels.
Model Details
This is a text completion model, designed to advance a story a few lines at a time.
- Developed by: https://huggingface.co/molbal
- Model type: Mistral 7b fine-tune
- Language(s) (NLP): English only
- License: wtfpl
- Finetuned from model: unsloth/mistral-7b-bnb-4bit
- Notes: This model is in 4bit quants only, as its primary purpose is experimentation and that's what performs well locally on my laptop
Framework versions
- PEFT 0.10.0
- Unsloth for training
- Downloads last month
- 9
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.