Commit
•
62f41f1
1
Parent(s):
4f9f31c
Update README.md
Browse files
README.md
CHANGED
|
@@ -29,6 +29,12 @@ We used the SOTA(State Of The Art) [Language Model Evaluation Harness](https://g
|
|
| 29 |
|
| 30 |
|
| 31 |
The following is the performance under 0-shot testing, mostly better than acrastt/Marx-3B-V2
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
|
| 33 |
|
| 34 |
hf-causal (pretrained=CobraMamba/mamba-gpt-3b-v4), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
|
|
|
|
| 29 |
|
| 30 |
|
| 31 |
The following is the performance under 0-shot testing, mostly better than acrastt/Marx-3B-V2
|
| 32 |
+
| Task |Version| Metric |Value | |Stderr|
|
| 33 |
+
|-------------|------:|--------|-----:|---|-----:|
|
| 34 |
+
|anli_r1 | 0|acc |0.3300|± |0.0149|
|
| 35 |
+
|anli_r2 | 0|acc |0.3420|± |0.0150|
|
| 36 |
+
|anli_r3 | 0|acc |0.3525|± |0.0138|
|
| 37 |
+
|
| 38 |
|
| 39 |
|
| 40 |
hf-causal (pretrained=CobraMamba/mamba-gpt-3b-v4), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
|