GGUF
Not-For-All-Audiences
nsfw
Inference Endpoints
Undi95 commited on
Commit
6e02f57
1 Parent(s): 23adc1e

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +69 -0
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ tags:
4
+ - not-for-all-audiences
5
+ - nsfw
6
+ ---
7
+
8
+ <!-- description start -->
9
+ ## Description
10
+
11
+ This repo contains fp16 files of Mistral-RP-0.1-7B.
12
+
13
+ Here is the recipe:
14
+ ```shell
15
+ slices:
16
+ - sources:
17
+ - model: migtissera/Synthia-7B-v1.3
18
+ layer_range: [0, 32]
19
+ - model: Undi95/Mistral-small_pippa_limaRP-v3-7B
20
+ layer_range: [0, 32]
21
+ merge_method: slerp
22
+ base_model: migtissera/Synthia-7B-v1.3
23
+ parameters:
24
+ t:
25
+ - filter: lm_head
26
+ value: [0.75]
27
+ - filter: embed_tokens
28
+ value: [0.75]
29
+ - filter: self_attn
30
+ value: [0.75, 0.25]
31
+ - filter: mlp
32
+ value: [0.25, 0.75]
33
+ - filter: layernorm
34
+ value: [0.5, 0.5]
35
+ - filter: modelnorm
36
+ value: [0.75]
37
+ - value: 0.5 # fallback for rest of tensors
38
+ dtype: float16
39
+ ```
40
+ <!-- description end -->
41
+ <!-- description start -->
42
+ ## Model and lora used
43
+
44
+ - [Mistral-7B-small_pippa_limaRP-v3-lora](https://huggingface.co/Undi95/Mistral-7B-small_pippa_limaRP-v3-lora)
45
+ - [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)
46
+ - [Synthia-7B-v1.3](https://huggingface.co/migtissera/Synthia-7B-v1.3)
47
+
48
+ ## Prompt template: Alpaca
49
+
50
+ ```
51
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
52
+
53
+ ### Instruction:
54
+ {prompt}
55
+
56
+ ### Response:
57
+
58
+ ```
59
+
60
+ ## LimaRP v3 usage and suggested settings
61
+
62
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/ZC_iP2KkcEcRdgG_iyxYE.png)
63
+
64
+ You can follow these instruction format settings in SillyTavern. Replace tiny with your desired response length:
65
+
66
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/PIn8_HSPTJEMdSEpNVSdm.png)
67
+ <!-- description end -->
68
+
69
+ If you want to support me, you can [here](https://ko-fi.com/undiai).