mrm8488 commited on
Commit
9f08275
1 Parent(s): f10fb29

Fix `eos_token_id`

Browse files

It seems `eos_token_id` is `<|end|>` (32007) instead of `<|endoftext|>` (32000).
Context: https://twitter.com/altryne/status/1783567596467491109?t=k5HHVmTCGDt4-TkXF8KyNw&s=19

Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -10,7 +10,7 @@
10
  },
11
  "bos_token_id": 1,
12
  "embd_pdrop": 0.0,
13
- "eos_token_id": 32000,
14
  "hidden_act": "silu",
15
  "hidden_size": 3072,
16
  "initializer_range": 0.02,
 
10
  },
11
  "bos_token_id": 1,
12
  "embd_pdrop": 0.0,
13
+ "eos_token_id": 32007,
14
  "hidden_act": "silu",
15
  "hidden_size": 3072,
16
  "initializer_range": 0.02,