mlabonne commited on
Commit
0b60535
1 Parent(s): 0e995d4

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ hermes-3-llama-3.1-8b-lorablated.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
+ hermes-3-llama-3.1-8b-lorablated.bf16.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - NousResearch/Hermes-3-Llama-3.1-8B
4
+ library_name: transformers
5
+ tags:
6
+ - mergekit
7
+ - merge
8
+ - autoquant
9
+ - gguf
10
+ ---
11
+ # Hermes-3-Llama-3.1-8B-lorablated
12
+
13
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B) + Llama-3.1-8B-Instruct-abliterated-LORA as a base.
16
+
17
+
18
+ ## 🧩 Configuration
19
+
20
+ The following YAML configuration was used to produce this model:
21
+
22
+ ```yaml
23
+ base_model: NousResearch/Hermes-3-Llama-3.1-8B+Llama-3.1-8B-Instruct-abliterated-LORA
24
+ dtype: bfloat16
25
+ merge_method: task_arithmetic
26
+ parameters:
27
+ normalize: false
28
+ slices:
29
+ - sources:
30
+ - layer_range: [0, 32]
31
+ model: NousResearch/Hermes-3-Llama-3.1-8B+Llama-3.1-8B-Instruct-abliterated-LORA
32
+ parameters:
33
+ weight: 1.0
34
+ ```
hermes-3-llama-3.1-8b-lorablated.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84769f4400bf2c62c0cfd4e4030d8cd2c76ccb52b0e2c798cb02f6b32d93ef1f
3
+ size 8540770688
hermes-3-llama-3.1-8b-lorablated.bf16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da18441efe7e993a5178572825cc94282748c688c2f9150477d59247fedd636b
3
+ size 16068891008