jncraton commited on
Commit
f5a4c7e
1 Parent(s): ad5819b

Fix EOS token id

Browse files

This change adjusts the eos_token_id to match an update to the original model. Here's the commit that updated the original model for reference:

https://huggingface.co/openchat/openchat-3.5-0106/commit/aa20a27ebc320797c96dd18ff596fe74df4b6e1d

I'm currently having to manually set the stop_token_ids in vllm in order get this model to terminate properly. I believe that this change will solve that issue.

Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -5,7 +5,7 @@
5
  ],
6
  "attention_dropout": 0.0,
7
  "bos_token_id": 1,
8
- "eos_token_id": 2,
9
  "hidden_act": "silu",
10
  "hidden_size": 4096,
11
  "initializer_range": 0.02,
 
5
  ],
6
  "attention_dropout": 0.0,
7
  "bos_token_id": 1,
8
+ "eos_token_id": 32000,
9
  "hidden_act": "silu",
10
  "hidden_size": 4096,
11
  "initializer_range": 0.02,