Reiterate3680 commited on
Commit
579b80a
1 Parent(s): 009bba9

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: openlynn/Soliloquy-7B-v3
3
+ language:
4
+ - en
5
+ license: other
6
+ pipeline_tag: text-generation
7
+ quantized_by: Reiterate3680
8
+ ---
9
+ L quants (or more), for fun/testing, probably prefer bartowski or mradermacher's quants if available
10
+
11
+ Original Model: https://huggingface.co/openlynn/Soliloquy-7B-v3
12
+
13
+ Made with a modified version of https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script
14
+
15
+ Q2_K_L, Q4_K_L, Q5_K_L, Q6_K_L, are using Q_8 output tensors and token embeddings. imatrix is done using bartowski's imatrix dataset