tnscorcoran
/

Llama-2-7b-chat-hf-sharded-bf16-fine-tuned-adapters

Model card Files Files and versions Community

tnscorcoran commited on Mar 4

Commit

5c422be

•

1 Parent(s): 4b14d02

Upload model

Files changed (3) hide show

README.md +2 -4
adapter_config.json +3 -2
adapter_model.bin +1 -1

README.md CHANGED Viewed

@@ -81,7 +81,7 @@ Use the code below to get started with the model.
 [More Information Needed]
-### Training Procedure
 <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
@@ -197,8 +197,6 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
 ## Model Card Contact
 [More Information Needed]
 ### Framework versions
-- PEFT 0.8.2

 [More Information Needed]
+### Training Procedure
 <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
 ## Model Card Contact
 [More Information Needed]
 ### Framework versions
+- PEFT 0.9.1.dev0

adapter_config.json CHANGED Viewed

@@ -20,10 +20,11 @@
   "revision": null,
   "target_modules": [
     "self_attn.v_proj",
-    "self_attn.k_proj",
     "self_attn.q_proj",
-    "self_attn.o_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_rslora": false
 }

   "revision": null,
   "target_modules": [
     "self_attn.v_proj",
     "self_attn.q_proj",
+    "self_attn.o_proj",
+    "self_attn.k_proj"
   ],
   "task_type": "CAUSAL_LM",
+  "use_dora": false,
   "use_rslora": false
 }

adapter_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1ca1c71c216fc36780021e2d5f54fb4d416485ef7274cc28933d0ecf12a554c4
 size 33646858

 version https://git-lfs.github.com/spec/v1
+oid sha256:9c9df6b31f3ca395676d6732dc17d7e3f2eb6e9065d1246fc5969ca71577fd81
 size 33646858