GPT4-X-Alpasta-30b / README.md
MetaIX's picture
Update README.md
fba2629
|
raw
history blame
850 Bytes
Dont be upsetti, here, have some spaghetti! Att: A'eala <3
<p><strong><font size="5">Information</font></strong></p>
GPT4-X-Alpasta-30b working with Oobabooga's Text Generation Webui and KoboldAI.
<p>This is an attempt at improving Open Assistant's performance as an instruct while retaining its excellent prose. The merge consists of <a href="https://huggingface.co/chansung/gpt4-alpaca-lora-30b">Chansung's GPT4-Alpaca Lora</a> and <a href="https://huggingface.co/OpenAssistant/oasst-sft-6-llama-30b-xor">Open Assistant's native fine-tune</a>.</p>
<p><strong><font size="5">Benchmarks</font></strong></p>
<p><strong><font size="4">FP16 (These are actually 4-bit benchmarks) (Placeholder)</font></strong></p>
<strong>Wikitext2</strong>: 4.998758792877197
<strong>Ptb-New</strong>: 9.802155494689941
<strong>C4-New</strong>: 7.341384410858154