uukuguy commited on
Commit
9c43bd4
1 Parent(s): 881e73c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md CHANGED
@@ -13,6 +13,34 @@ license: llama2
13
  <p><h1> speechless-codellama-34b-v1.0 </h1></p>
14
  Fine-tune the Phind/Phind-CodeLlama-34B with Dolphin (1% GPT4), Orca (1% GPT4) and Platypus (100%) datasets.
15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  | Metric | Value |
17
  | --- | --- |
18
  | ARC | 52.47 |
 
13
  <p><h1> speechless-codellama-34b-v1.0 </h1></p>
14
  Fine-tune the Phind/Phind-CodeLlama-34B with Dolphin (1% GPT4), Orca (1% GPT4) and Platypus (100%) datasets.
15
 
16
+ | Metric | Value |
17
+ | --- | --- |
18
+ | humaneval-python | 70.12 |
19
+
20
+ [Big Code Models Leaderboard](https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard)
21
+
22
+ Phind-CodeLlama-34B-v2: 71.95
23
+
24
+ WizardCoder-Python-34B-V1.0: 70.73
25
+
26
+ Phind-CodeLlama-34B-v1: 65.85
27
+
28
+ WizardCoder-Python-13B-V1.0: 62.19
29
+
30
+ CodeLlama-34B-Python: 53.29
31
+
32
+ CodeLlama-34B-Instruct: 50.79
33
+
34
+ CodeLlama-13B-Instruct: 50.6
35
+
36
+ CodeLlama-34B: 45.11
37
+
38
+ CodeLlama-13B-Python: 42.89
39
+
40
+ CodeLlama-13B: 35.07
41
+
42
+ [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
43
+
44
  | Metric | Value |
45
  | --- | --- |
46
  | ARC | 52.47 |