| library_name: transformers | |
| tags: [] | |
| # Model Card for Model ID | |
| Optimum GPTQ quantized 8-bit version of Mixtral-8x22B-Instruct-v0.1 \ | |
| WIP - do not use currently \ | |
| See original model card for more information. | |
| # How to load | |
| library_name: transformers | |
| tags: [] | |
| # Model Card for Model ID | |
| Optimum GPTQ quantized 8-bit version of Mixtral-8x22B-Instruct-v0.1 \ | |
| WIP - do not use currently \ | |
| See original model card for more information. | |
| # How to load | |