LM studio Loading error

#1
by Vezora - opened

Does the latest release of LM studio 0.2.25 support this model? I just downloaded the model in LM Studio (latest release 0.2.25 on Windows) and when I hover over the model to load it says "this model architecture is not supported". And when i try to load it, it gives me an error.

"(Exit code: -1073740791). Unknown error. Try a different model and/or config."
{
"memory": {
"ram_capacity": "127.90 GB",
"ram_unused": "97.96 GB"
},
"gpu": {
"gpu_names": [
"NVIDIA GeForce RTX 3090"
],
"vram_recommended_capacity": "24.00 GB",
"vram_unused": "22.76 GB"
},
"os": {
"platform": "win32",
"version": "10.0.22631"
},
"app": {
"version": "0.2.25",
"downloadsDir": "C:\Users\bobni\.cache\lm-studio\models"
},
"model": {}
}

Same here. I am getting the following error:
"llama.cpp error: 'error loading model architecture: unknown model architecture: 'deepseek2''"

and diagnostic info:
{
"memory": {
"ram_capacity": "96.00 GB",
"ram_unused": "10.00 GB"
},
"gpu": {
"gpu_names": [
"Apple Silicon"
],
"vram_recommended_capacity": "72.00 GB",
"vram_unused": "7.65 GB"
},
"os": {
"platform": "darwin",
"version": "14.4"
},
"app": {
"version": "0.2.24",
"downloadsDir": "/Users/xam/.cache/lm-studio/models"
},
"model": {}
}

LM Studio Community org

try disabling flash attention, i'm not sure why it's being listed as an unknown architecture

Thanks for your support. In my case I might be missing something, but flash attention seems to already be disabled by default. See the image:

image.png

LM Studio Community org

oh @xavieranguera you might need an update as well to 0.2.25

Ok, this solved the issue.
Note for others: while on the app the latest version available (when checking for updates) is 0.2.24, on the website the new version is already available.
Thanks @bartowski !

Thank you this fixed the problem, and yeah it is strangely showing unsupported model, but with FA2 turned off it loads :) @bartowski

Vezora changed discussion status to closed

Sign up or log in to comment