File size: 298 Bytes
460608c 578137d 460608c 578137d |
1 2 3 4 5 6 7 8 9 |
---
library_name: transformers
tags: []
---
# BrokenSoul/GPT2-GPTQ-4bit
<!-- Provide a quick summary of what the model is/does. -->
This is a GPT2 Quantized model following this tutorial: [4-bit LLM Quantization with GPTQ](https://mlabonne.github.io/blog/posts/4_bit_Quantization_with_GPTQ.html). |