TheBloke commited on
Commit
c0ba9f8
1 Parent(s): d5125d0

GPTQ model commit

Browse files
Files changed (1) hide show
  1. generation_config.json +4 -0
generation_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "max_new_tokens": 4096,
3
+ "transformers_version": "4.28.1"
4
+ }