Adding Evaluation Results
#15 opened 10 months ago
by
leaderboard-pr-bot
![](https://cdn-avatars.huggingface.co/v1/production/uploads/655506df9dc61e22c5f9c732/IZGvup0FdVlioPPIPnzZv.jpeg)
is it possible to use a continuous batching inference server with this model?
#14 opened 11 months ago
by
natserrano
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1676592730904-noauth.jpeg)
Can the model be sharded over several GPUs?
1
#13 opened about 1 year ago
by
silverfisk
Works well on a 3090 ! Insane good !
1
#11 opened over 1 year ago
by
goldrushgames
Anyone has been successful in deploying this to Sagemaker or so?
#9 opened over 1 year ago
by
rafa9
Model exits in Windows Booga
8
#8 opened over 1 year ago
by
0spr4y
Model Performance Curiosity
3
#7 opened over 1 year ago
by
sumuks
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64676c81e7a6a374fd181110/rtnpiocPK5mIj2pcB2TId.jpeg)
Have a problem with rtx4090
17
#6 opened over 1 year ago
by
crainto
i got messy code
5
#3 opened over 1 year ago
by
Tiankong2023
Will this work with the Local LLMs One-Click UI runpod?
7
#2 opened over 1 year ago
by
nichedreams
How much vram+ram 30B needs? I have 3060 12gb + 32gb ram.
21
#1 opened over 1 year ago
by
DaveScream