Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-v0.10-GGUF
like
2
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
text-generation-inference
imatrix
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
59bfc22
Llama-3-8B-Instruct-v0.10-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
e19eb7811135e946240211c245322704019a32c65dc9d56104c638522ef53393
59bfc22
verified
3 months ago
.gitattributes
2.26 kB
e19eb7811135e946240211c245322704019a32c65dc9d56104c638522ef53393
3 months ago
Llama-3-8B-Instruct-v0.10.IQ1_M.gguf
2.16 GB
LFS
d7e227580893228e9c794a304426f00be7df5bb9adadf3148637c62bc19e58f1
3 months ago
Llama-3-8B-Instruct-v0.10.IQ2_XS.gguf
2.61 GB
LFS
f0843cabf141523700f59d68b739831fbb7ed0d598e566e856026dc470e8a59a
3 months ago
Llama-3-8B-Instruct-v0.10.IQ3_XS.gguf
3.52 GB
LFS
60e5fd8deddef2cd45aab15ee243244fee820ce3730b367eabbf0e68f432a923
3 months ago
Llama-3-8B-Instruct-v0.10.IQ4_XS.gguf
4.45 GB
LFS
87c1bf46661416f2fd6d30788198a7efaca1114d22df6e9347a348a56e2ac054
3 months ago
Llama-3-8B-Instruct-v0.10.Q2_K.gguf
3.18 GB
LFS
27781cf06056b93c993b771f4f03cf5991a5a03cee981540dfeec08b3862ddde
3 months ago
Llama-3-8B-Instruct-v0.10.Q3_K_L.gguf
4.32 GB
LFS
6511749b7c95e7a933d33a6a180a34960202dd8b5c6f91b748927345f3a605f3
3 months ago
Llama-3-8B-Instruct-v0.10.Q3_K_M.gguf
4.02 GB
LFS
bfba03c8e82e40bfc5ed76281d0cd5c769a80c33f56a1dc7aef0bebd585a1eeb
3 months ago
Llama-3-8B-Instruct-v0.10.Q3_K_S.gguf
3.66 GB
LFS
9d5fdb1fbe3dea2f517e088b4f83cb0843644222c2afa7d32039a1c9bb05864f
3 months ago
Llama-3-8B-Instruct-v0.10.Q4_K_M.gguf
4.92 GB
LFS
6b2b5002cccd1d372d96a10aa282d8b86e88b5474297565e8afae8eb0e2c02fa
3 months ago
Llama-3-8B-Instruct-v0.10.Q4_K_S.gguf
4.69 GB
LFS
e19eb7811135e946240211c245322704019a32c65dc9d56104c638522ef53393
3 months ago
README.md
27 Bytes
initial commit
3 months ago
