Hugging Face's logo

brittlewis12
/
aanaphi2-v0.1-GGUF

Text Generation
GGUF
English
conversational
Model card Files Community
aanaphi2-v0.1-GGUF / README.md
brittlewis12's picture
brittlewis12
Create README.md
4a8b4dd verified
preview code
|
raw
history blame contribute delete
2.65 kB
metadata
base_model: mobiuslabsgmbh/aanaphi2-v0.1
license: mit
train: false
inference: false
language:
  - en
model_creator: mobiuslabsgmbh
model_name: aanaphi2-v0.1
model_type: phi
pipeline_tag: text-generation
quantized_by: brittlewis12

elephant-samurai

aanaphi2-v0.1 GGUF

Original model: aanaphi2-v0.1

Model creator: mobiuslabsgmbh

This repo contains GGUF format model files for Mobius Labs’ aanaphi2-v0.1.

aanaphi2-v0.1 is a finetuned (SFT + DPO) chat model based on Microsoft's Phi-2 base model (2.8B parameters).

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 2276 (revision b11a93d)

Prompt template 

### Human: {{prompt}}
### Assistant:

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs.ai

cnvrs is the best app for private, local AI on your device:

  • create & save Characters with custom system prompts & temperature settings
  • download and experiment with any GGUF model you can find on HuggingFace!
  • make it your own with custom Theme colors
  • powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
  • try it out yourself today, on Testflight!
  • follow cnvrs on twitter to stay up to date

Original Model Evaluation

Models phi-2 aanaphi2-v0.1
ARC (25-shot) 61.09 63.74
HellaSwag (10-shot) 75.11 78.30
MMLU (5-shot) 58.11 57.70
TruthfulQA-MC2 44.47 51.56
Winogrande (5-shot) 74.35 73.40
GSM8K (5-shot) 54.81 58.61
Average 61.33 63.89