Muennighoff commited on
Commit
148e7a5
1 Parent(s): 7b5134c

Update config.json

Browse files

Discussed here: Discussed here: https://huggingface.co/bigscience/bloom/discussions/77#63331c7266b27c4ad1957d52

Files changed (1) hide show
  1. config.json +0 -1
config.json CHANGED
@@ -21,7 +21,6 @@
21
  "num_attention_heads": 16,
22
  "offset_alibi": 100,
23
  "pretraining_tp": 1,
24
- "seq_length": 2048,
25
  "skip_bias_add": true,
26
  "skip_bias_add_qkv": false,
27
  "transformers_version": "4.20.0",
 
21
  "num_attention_heads": 16,
22
  "offset_alibi": 100,
23
  "pretraining_tp": 1,
 
24
  "skip_bias_add": true,
25
  "skip_bias_add_qkv": false,
26
  "transformers_version": "4.20.0",