Hugging Face's logo

LogicismTV
/
Chronomaid-Storytelling-13b-exl2

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Model card Files Community
Chronomaid-Storytelling-13b-exl2
File size: 4,459 Bytes 
4492672
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
 
---
base_model: NyxKrage/Chronomaid-Storytelling-13b
inference: false
license: llama2
model_creator: Carsten Kragelund
model_name: Chronomaid Storytelling 13B
model_type: llama
prompt_template: 'Below is an instruction that describes a task. Write a response
  that appropriately completes the request.


  ### Instruction:

  {prompt}


  ### Response:

  '
quantized_by: LogicismTV
---
<div style="width: auto; margin-left: auto; margin-right: auto">
<img src="https://i.imgur.com/T1kcNir.jpg" style="width: 100%; min-width: 400px; display: block; margin: auto;">
</div>
<div style="display: flex; justify-content: space-between; width: 100%;">
    <div style="display: flex; flex-direction: column; align-items: flex-start;">
        <p style="margin-top: 0.5em; margin-bottom: 0em;"><a href="https://logicism.tv/">Vist my Website</a></p>
    </div>
    <div style="display: flex; flex-direction: column; align-items: flex-end;">
        <p style="margin-top: 0.5em; margin-bottom: 0em;"><a href="https://discord.gg/nStuNeZsWz">Join my Discord</a></p>
    </div>
</div>
<hr style="margin-top: 1.0em; margin-bottom: 1.0em;">

# Chronomaid Storytelling 13B - ExLlama V2

Original model: [Chronomaid Storytelling 13B](https://huggingface.co/NyxKrage/Chronomaid-Storytelling-13b)

# Description

This is an EXL2 quantization of the NyxKrage's Chronomaid Storytelling 13B model.

## Prompt template: Alpaca

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

```

# Quantizations

| Bits Per Weight | Size |
| --------------- | ---- |
| [main (2.4bpw)](https://huggingface.co/LogicismTV/Chronomaid-Storytelling-13b-exl2/tree/main) | 3.98 GB |
| [3bpw](https://huggingface.co/LogicismTV/Chronomaid-Storytelling-13b-exl2/tree/3bpw) | 4.86 GB |
| [3.5bpw](https://huggingface.co/LogicismTV/Chronomaid-Storytelling-13b-exl2/tree/3.5bpw) | 5.60 GB |
| [4bpw](https://huggingface.co/LogicismTV/Chronomaid-Storytelling-13b-exl2/tree/4bpw) | 6.34 GB |
| [4.5bpw](https://huggingface.co/LogicismTV/Chronomaid-Storytelling-13b-exl2/tree/4.5bpw) | 7.08 GB |
| [5bpw](https://huggingface.co/LogicismTV/Chronomaid-Storytelling-13b-exl2/tree/5bpw) | 7.82 GB |
| [6bpw](https://huggingface.co/LogicismTV/Chronomaid-Storytelling-13b-exl2/tree/6bpw) | 9.29 GB |
| [8bpw](https://huggingface.co/LogicismTV/Chronomaid-Storytelling-13b-exl2/tree/8bpw) | 12.2 GB |


# Original model card: Carsten Kragelund's Chronomaid Storytelling 13B


# Chronomaid-Storytelling-13b

<img src="https://cdn-uploads.huggingface.co/production/uploads/65221315578e7da0d74f73d8/v2fVXhCcOdvOdjTrd9dY0.webp" alt="image of a vibrant and whimsical scene with an anime-style character as the focal point. The character is a young girl with blue eyes and short brown hair, wearing a black and white maid outfit with ruffled apron and a red ribbon at her collar. She is lying amidst a fantastical backdrop filled with an assortment of floating, colorful clocks, gears, and hourglasses. The space around her is filled with sparkling stars, glowing nebulae, and swirling galaxies." height="75%" width="75%" />

Merge including [Noromaid-13b-v0.1.1](https://huggingface.co/NeverSleep/Noromaid-13b-v0.1.1), and [Chronos-13b-v2](https://huggingface.co/elinas/chronos-13b-v2) with the [Storytelling-v1-Lora](https://huggingface.co/Undi95/Storytelling-v1-13B-lora) applied afterwards

Inteded for primarily RP, and will do ERP, narrator-character and group-chats without much trouble in my testing.

## Prompt Format

Tested with Alpaca, the Noromaid preset's will probably also work (check the Noromaid model card for SillyTavern presets)
```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:
```

## Sampler Settings

Tested at 
* `temp` 1.3 `min p` 0.05 and 0.15
* `temp` 1.7, `min p` 0.08 and 0.15

## Quantized Models
The model has been kindly quantized in GGUF, AWQ, and GPTQ by TheBloke  
Find them in the [Chronomaid-Storytelling-13b Collection](https://huggingface.co/collections/NyxKrage/chronomaid-storytelling-13b-656115dd7065690d7f17c7c8)

## Thanks ❤️

To [Undi](https://huggingface.co/Undi95) & [Ikari](https://huggingface.co/IkariDev) for Noromaid and [Elinas](https://huggingface.co/elinas) for Chronos  
Support [Undi](https://ko-fi.com/undiai) and [Elinas](https://ko-fi.com/elinas) on Kofi