Update README.md
Browse files
README.md
CHANGED
|
@@ -149,18 +149,18 @@ Below are comparisions of this model with other models in the 7B regime.
|
|
| 149 |
| Model | Params | Tokens | Open dataset? | CORE | MMLU | EXTENDED |
|
| 150 |
|---------------|--------|--------|---------------|----------|----------|----------|
|
| 151 |
| **Open weights, closed datasets** | | | | | | |
|
| 152 |
-
| Llama2 | 7B | 2T |
|
| 153 |
-
| DeepSeek | 7B | 2T |
|
| 154 |
-
| Mistral-0.3 | 7B | ? |
|
| 155 |
-
| QWEN-2 | 7B | ? |
|
| 156 |
-
| Llama3 | 8B | 15T |
|
| 157 |
-
| Gemma | 8B | 6T |
|
| 158 |
-
| Phi-3 | 7B | ? |
|
| 159 |
| **Open weights, open datasets** | | | | | | |
|
| 160 |
-
| Falcon | 7B | 1T |
|
| 161 |
-
| OLMo-1.7 | 7B | 2.1T |
|
| 162 |
-
| MAP-Neo | 7B | 4.5T |
|
| 163 |
-
| **DCLM-7B** | 7B | 2.5T |
|
| 164 |
|
| 165 |
|
| 166 |
|
|
|
|
| 149 |
| Model | Params | Tokens | Open dataset? | CORE | MMLU | EXTENDED |
|
| 150 |
|---------------|--------|--------|---------------|----------|----------|----------|
|
| 151 |
| **Open weights, closed datasets** | | | | | | |
|
| 152 |
+
| Llama2 | 7B | 2T | ❌ | 49.2 | 45.8 | 34.1 |
|
| 153 |
+
| DeepSeek | 7B | 2T | ❌ | 50.7 | 48.5 | 35.3 |
|
| 154 |
+
| Mistral-0.3 | 7B | ? | ❌ | 57.0 | 62.7 | 45.1 |
|
| 155 |
+
| QWEN-2 | 7B | ? | ❌ | 57.5 | **71.9** | 50.5 |
|
| 156 |
+
| Llama3 | 8B | 15T | ❌ | 57.6 | 66.2 | 46.3 |
|
| 157 |
+
| Gemma | 8B | 6T | ❌ | 57.8 | 64.3 | 44.6 |
|
| 158 |
+
| Phi-3 | 7B | ? | ❌ | **61.0** | 69.9 | **57.9** |
|
| 159 |
| **Open weights, open datasets** | | | | | | |
|
| 160 |
+
| Falcon | 7B | 1T | ✅ | 44.1 | 27.4 | 25.1 |
|
| 161 |
+
| OLMo-1.7 | 7B | 2.1T | ✅ | 47.0 | 54.0 | 34.2 |
|
| 162 |
+
| MAP-Neo | 7B | 4.5T | ✅ | **50.2** | **57.1** | **40.4** |
|
| 163 |
+
| **DCLM-7B** | 7B | 2.5T | ✅ | **56.1** | **63.7** | **43.6** |
|
| 164 |
|
| 165 |
|
| 166 |
|