Edentns
/

DataVortexS-10.7B-v1.0

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

JeongwonChoi commited on Jan 16

Commit

196a63b

•

1 Parent(s): 60392b7

Update README.md

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -50,12 +50,12 @@ text = """\
 ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
-| Task             | 0-shot | 5-shot | 10-shot | 50-shot |
-| :--------------- | -----: | -----: | ------: | ------: |
-| kobest_boolq     |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_copa      |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_hellaswag |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_sentineg  |    0.0 |    0.0 |     0.0 |     0.0 |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**

 ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
+| Task             |   0-shot |   5-shot |  10-shot |  50-shot |
+| :--------------- | -------: | -------: | -------: | -------: |
+| kobest_boolq     | 0.334282 | 0.334282 | 0.334282 | 0.769923 |
+| kobest_copa      | 0.480501 | 0.475746 |  0.46338 | 0.475528 |
+| kobest_hellaswag | 0.225818 | 0.240596 | 0.234316 | 0.449779 |
+| kobest_sentineg  |  0.33165 | 0.386189 | 0.366913 | 0.360296 |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**