johnlui

/

chinese-alpaca-13b-plus-quantized

like 13

我使用text-generation-webui的One-click installers（Windows），运行提示：
错误信息：

INFO:Cache capacity is 0 bytes
llama.cpp: loading model from models\alpaca-13b-plus\ggml-model-q4_0.bin
llama_model_load_internal: format     = ggjt v1 (pre #1405)
llama_model_load_internal: n_vocab    = 49954
llama_model_load_internal: n_ctx      = 2048
llama_model_load_internal: n_embd     = 5120
llama_model_load_internal: n_mult     = 256
llama_model_load_internal: n_head     = 40
llama_model_load_internal: n_layer    = 40
llama_model_load_internal: n_rot      = 128
llama_model_load_internal: ftype      = 2 (mostly Q4_0)
llama_model_load_internal: n_ff       = 13824
llama_model_load_internal: n_parts    = 1
llama_model_load_internal: model size = 13B
error loading model: this format is no longer supported (see https://github.com/ggerganov/llama.cpp/pull/1305)
llama_init_from_file: failed to load model
Traceback (most recent call last):
  File "D:\APP\AI\oobabooga_windows\text-generation-webui\server.py", line 1045, in <module>
    shared.model, shared.tokenizer = load_model(shared.model_name)
  File "D:\APP\AI\oobabooga_windows\text-generation-webui\modules\models.py", line 95, in load_model
    output = load_func(model_name)
  File "D:\APP\AI\oobabooga_windows\text-generation-webui\modules\models.py", line 258, in llamacpp_loader
    model, tokenizer = LlamaCppModel.from_pretrained(model_file)
  File "D:\APP\AI\oobabooga_windows\text-generation-webui\modules\llamacpp_model.py", line 50, in from_pretrained
    self.model = Llama(**params)
  File "D:\APP\AI\oobabooga_windows\installer_files\env\lib\site-packages\llama_cpp\llama.py", line 161, in __init__
    assert self.ctx is not None
AssertionError
Exception ignored in: <function LlamaCppModel.__del__ at 0x00000232CE78C4C0>
Traceback (most recent call last):
  File "D:\APP\AI\oobabooga_windows\text-generation-webui\modules\llamacpp_model.py", line 23, in __del__
    self.model.__del__()
AttributeError: 'LlamaCppModel' object has no attribute 'model'

Done!