Edit model card

Explanation

  • With the base model, applied DPO to the small amount of layers with the open dataset , saved the adapter part
  • Attached the base model and the tuned adapter together

Base Model

Used Corpus

Score

Average Ko-ARC Ko-HellaSwag Ko-MMLU Ko-TruthfulQA Ko-CommonGen V2
56.24 53.33 64.36 55.63 45.42 62.46

Log

  • 2024.02.13: Initial version Upload

LICENSE

  • Apache 2.0
Downloads last month
2,011
Safetensors
Model size
10.8B params
Tensor type
FP16
·
Inference API
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train dddsaty/KoSOLAR-10.7B_DPO_Adapter_Attach