pankajmathur
/

orca_mini_v2_7b

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Pankaj Mathur commited on Jul 9, 2023

Commit

50686f1

•

1 Parent(s): 8aded8e

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -41,9 +41,9 @@ please note num_fewshots varies for each below task as used by HuggingFaceH4 Ope
 |**Task**|**num_fewshot**|**Version**|**Metric**|**Value**|**Stderr**|
 |*arc_challenge*|25|0|acc_norm|0.5077|0.0146|
 |*hellaswag*|10|0|acc_norm|0.7617|0.0043|
-|*mmlu*|5|0|acc_norm|-|-|
 |*truthfulqa_mc*|0|1|mc2|0.4399|0.0153|
-|*Total Average*|0|-|-|0.5697|0.0114|

 |**Task**|**num_fewshot**|**Version**|**Metric**|**Value**|**Stderr**|
 |*arc_challenge*|25|0|acc_norm|0.5077|0.0146|
 |*hellaswag*|10|0|acc_norm|0.7617|0.0043|
+|*mmlu*|5|0|acc_norm|0.3955|0.035|
 |*truthfulqa_mc*|0|1|mc2|0.4399|0.0153|
+|*Total Average*|0|-|-|0.5262|0.0173|