akshathmangudi/llama3.1-8b-quantized

Model Card for Model ID

This is the quantized version of Llama3.1-8B using bitsandbytes. More quantized LLMs coming soon...

Model Description

• Developed by: Meta
• Quantized by: Akshath Mangudi
• My GitHub: https://github.com/akshathmangudi
• My LinkedIn: https://www.linkedin.com/in/akshathmangudi/
• License: llama3.1

Model Source

• Repository: https://huggingface.co/meta-llama/Meta-Llama-3.1-8B