| Tasks | Metric | Value | Stderr | |
|---|---|---|---|---|
| hellaswag_it | acc | 0.4439 | ± | 0.0052 |
| acc_norm | 0.5962 | ± | 0.0051 | |
| arc_it | acc | 0.1257 | ± | 0.0097 |
| acc_norm | 0.4414 | ± | 0.0145 |
- Downloads last month
- 14
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.