Post
561
Running billion parameter models, sometimes we forget what it all is! 🤔💡
Matrix multiplication 🧮✨
While there are multiple plays on memory management and caching to speed it up! 🏎️💾⚡
The naive way of Matrix multiplication becomes even more fascinating the bigger these models get! 🤯📈
QKV for the win! 🏆🔑📚
GitHub: https://github.com/wentasah/mmul-anim
Slides: https://cw.fel.cvut.cz/wiki/_media/courses/b4m36esw/esw09_2019.pdf 📑🎓
Matrix multiplication 🧮✨
While there are multiple plays on memory management and caching to speed it up! 🏎️💾⚡
The naive way of Matrix multiplication becomes even more fascinating the bigger these models get! 🤯📈
QKV for the win! 🏆🔑📚
GitHub: https://github.com/wentasah/mmul-anim
Slides: https://cw.fel.cvut.cz/wiki/_media/courses/b4m36esw/esw09_2019.pdf 📑🎓
