Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment27pasticheT3qm7xp-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
99b29fa
Experiment27pasticheT3qm7xp-7B-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
fffa0150a79b5c4d878ccb9a8f9e4eb346693e118d871e2b17cd2f30442198f2
99b29fa
verified
4 months ago
.gitattributes
2.07 kB
fffa0150a79b5c4d878ccb9a8f9e4eb346693e118d871e2b17cd2f30442198f2
4 months ago
Experiment27pasticheT3qm7xp-7B.Q2_K.gguf
2.72 GB
LFS
1581aebe3bde7b925dac3085fc63983e79bd8111530a08f5a79193a2b0aceb59
4 months ago
Experiment27pasticheT3qm7xp-7B.Q3_K_L.gguf
3.82 GB
LFS
4f1b8d6cd289d694ebe9b53b288df98005bdacb442969d26292e1aa6c4c4371c
4 months ago
Experiment27pasticheT3qm7xp-7B.Q3_K_M.gguf
3.52 GB
LFS
063fabfda1c0a5ef10357782759840544a0d42051131ec5a49b0e060207a0090
4 months ago
Experiment27pasticheT3qm7xp-7B.Q3_K_S.gguf
3.16 GB
LFS
914ab46c0a948e3cc40356ecb98579cc5dd14ebdc53329c282200d25fbe609f9
4 months ago
Experiment27pasticheT3qm7xp-7B.Q4_K_M.gguf
4.37 GB
LFS
d237604b9c6fd745c259acf99b19c842f33878735f1d767b23abcf3de6854fcf
4 months ago
Experiment27pasticheT3qm7xp-7B.Q4_K_S.gguf
4.14 GB
LFS
117a23420c7f180c0901709863b4840821ff86bd44d4ece113769c95df849ee4
4 months ago
Experiment27pasticheT3qm7xp-7B.Q5_K_M.gguf
5.13 GB
LFS
fffa0150a79b5c4d878ccb9a8f9e4eb346693e118d871e2b17cd2f30442198f2
4 months ago