Update README.md
Browse files
README.md
CHANGED
|
@@ -6,6 +6,15 @@ library_name: transformers
|
|
| 6 |
---
|
| 7 |
|
| 8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
This model was created with the help of several members of Anthracite.
|
| 10 |
|
| 11 |
NeuroCom v2 fixes several issues with the original NeuroCom train. I have deduplicated several datasets and applied a noisy training approach devised by Kalomaze. This model should have better generalization capabilities than the original, and in subjective testing of 3 variants, this was my favorite.
|
|
|
|
| 6 |
---
|
| 7 |
|
| 8 |
|
| 9 |
+
```
|
| 10 |
+
| Groups |Version|Filter|n-shot|Metric| |Value | |Stderr|
|
| 11 |
+
|------------------|------:|------|------|------|---|-----:|---|-----:|
|
| 12 |
+
|mmlu | 2|none | |acc |_ |0.5821|_ |0.0039|
|
| 13 |
+
| - humanities | 2|none | |acc |_ |0.5343|_ |0.0068|
|
| 14 |
+
| - other | 2|none | |acc |_ |0.6508|_ |0.0082|
|
| 15 |
+
| - social sciences| 2|none | |acc |_ |0.6776|_ |0.0082|
|
| 16 |
+
| - stem | 2|none | |acc |_ |0.4925|_ |0.0086|
|
| 17 |
+
```
|
| 18 |
This model was created with the help of several members of Anthracite.
|
| 19 |
|
| 20 |
NeuroCom v2 fixes several issues with the original NeuroCom train. I have deduplicated several datasets and applied a noisy training approach devised by Kalomaze. This model should have better generalization capabilities than the original, and in subjective testing of 3 variants, this was my favorite.
|