AttributeError: 'xTrimoPGLMTokenizer' object has no attribute '_update_trie'
File "Testing.py", line 6, in
tokenizer = AutoTokenizer.from_pretrained("/data2/xtrimopglm", trust_remote_code=True, use_fast=True)
File "/home/caihh/anaconda3/envs/pytorch/lib/python3.7/site-packages/transformers/models/auto/tokenization_auto.py", line 678, in from_pretrained
return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
File "/home/caihh/anaconda3/envs/pytorch/lib/python3.7/site-packages/transformers/tokenization_utils_base.py", line 1835, in from_pretrained
**kwargs,
File "/home/caihh/anaconda3/envs/pytorch/lib/python3.7/site-packages/transformers/tokenization_utils_base.py", line 1988, in _from_pretrained
tokenizer = cls(*init_inputs, **init_kwargs)
File "/home/caihh/.cache/huggingface/modules/transformers_modules/xtrimopglm/tokenization_xtrimopglm.py", line 54, in init
self._update_trie(self.unique_no_split_tokens)
AttributeError: 'xTrimoPGLMTokenizer' object has no attribute '_update_trie'