Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment28T3q-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
180086a
Experiment28T3q-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
ef97227172f902204888b270987eb4b2e0d538e2eeec1f2efdbb4cba3d055141
180086a
verified
6 months ago
.gitattributes
2.25 kB
ef97227172f902204888b270987eb4b2e0d538e2eeec1f2efdbb4cba3d055141
6 months ago
Experiment28T3q-7B.IQ3_XS.gguf
3.02 GB
LFS
99d83e6e2c7156e5cc500270837c32d73c0f468b5e07e0f18af3387e063f2b7f
6 months ago
Experiment28T3q-7B.IQ4_XS.gguf
3.94 GB
LFS
9377c2c80ce15a7eb584f5dd1e4798e817aa260bf3e88a9a4f0a167780b1fa1e
6 months ago
Experiment28T3q-7B.Q2_K.gguf
2.72 GB
LFS
f8015d626e8e3f15c96672da37f7f1d0a830c451fd0b3f328846d24999987196
6 months ago
Experiment28T3q-7B.Q3_K_L.gguf
3.82 GB
LFS
13a394b81a4ea2a6109f2f40ebc2f52eda96b301a4e9ce5803e734fe22324516
6 months ago
Experiment28T3q-7B.Q3_K_M.gguf
3.52 GB
LFS
2604271e1b4bd33d08391707883b97f269c137ceabccb3e2c53cb0b001d586e6
6 months ago
Experiment28T3q-7B.Q3_K_S.gguf
3.16 GB
LFS
ced35284d03b68ba357a18323c7faeba98ca73c55e6119eccad23f46187cef54
6 months ago
Experiment28T3q-7B.Q4_K_M.gguf
4.37 GB
LFS
a8d9fd930cf0f713529d7a195ecb48f627c997938da788593cc2f79ff0a01962
6 months ago
Experiment28T3q-7B.Q4_K_S.gguf
4.14 GB
LFS
5e8d69e33bc0509312a88222f8a67c81b8b6236d3f2feda0316141bb3b9a8a05
6 months ago
Experiment28T3q-7B.Q5_K_M.gguf
5.13 GB
LFS
37f98ee4e529ca77e273758ba40c911fbef718646349f27378fd8339f3eacd0e
6 months ago
Experiment28T3q-7B.Q5_K_S.gguf
5 GB
LFS
6ddfd19a958fdb35b502932d1bde7d6111e72863575a40d04f8933bb5aa0c70c
6 months ago
Experiment28T3q-7B.Q6_K.gguf
5.94 GB
LFS
ef97227172f902204888b270987eb4b2e0d538e2eeec1f2efdbb4cba3d055141
6 months ago
