VRAM requirement
3
#5 opened 5 months ago
by
jithinmukundan
Can VLLM be used for loading?
6
#4 opened 5 months ago
by
wawoshashi
How many bits and what is the groupsize?
1
#3 opened 5 months ago
by
vitvit
What library was used to quantize the model?
1
#2 opened 5 months ago
by
KirillR
How to load command r+ in text-generation-webui?
5
#1 opened 5 months ago
by
MLDataScientist