Update README.md
Browse files
README.md
CHANGED
@@ -13,6 +13,34 @@ license: llama2
|
|
13 |
<p><h1> speechless-codellama-34b-v1.0 </h1></p>
|
14 |
Fine-tune the Phind/Phind-CodeLlama-34B with Dolphin (1% GPT4), Orca (1% GPT4) and Platypus (100%) datasets.
|
15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
| Metric | Value |
|
17 |
| --- | --- |
|
18 |
| ARC | 52.47 |
|
|
|
13 |
<p><h1> speechless-codellama-34b-v1.0 </h1></p>
|
14 |
Fine-tune the Phind/Phind-CodeLlama-34B with Dolphin (1% GPT4), Orca (1% GPT4) and Platypus (100%) datasets.
|
15 |
|
16 |
+
| Metric | Value |
|
17 |
+
| --- | --- |
|
18 |
+
| humaneval-python | 70.12 |
|
19 |
+
|
20 |
+
[Big Code Models Leaderboard](https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard)
|
21 |
+
|
22 |
+
Phind-CodeLlama-34B-v2: 71.95
|
23 |
+
|
24 |
+
WizardCoder-Python-34B-V1.0: 70.73
|
25 |
+
|
26 |
+
Phind-CodeLlama-34B-v1: 65.85
|
27 |
+
|
28 |
+
WizardCoder-Python-13B-V1.0: 62.19
|
29 |
+
|
30 |
+
CodeLlama-34B-Python: 53.29
|
31 |
+
|
32 |
+
CodeLlama-34B-Instruct: 50.79
|
33 |
+
|
34 |
+
CodeLlama-13B-Instruct: 50.6
|
35 |
+
|
36 |
+
CodeLlama-34B: 45.11
|
37 |
+
|
38 |
+
CodeLlama-13B-Python: 42.89
|
39 |
+
|
40 |
+
CodeLlama-13B: 35.07
|
41 |
+
|
42 |
+
[Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
43 |
+
|
44 |
| Metric | Value |
|
45 |
| --- | --- |
|
46 |
| ARC | 52.47 |
|