Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
onekq 
posted an update about 9 hours ago
Post
46
I am starting a new series on matrix. The idea came to me when I wrote about the Muon optimizer.

Matrix itself has lots of fascinating properties and is applied in STEM fields for many decades. Its application in ML is just the beginning. There are lots of low hanging fruits. At the very least, I hope this math perspective will give you a new lens.

https://huggingface.co/blog/onekq/matrices-transformers-preface

Thank you for sharing. However, focusing on foundational linear algebra concepts first would help learners build a stronger foundation. Introducing transformers and LLMs right away could overwhelm beginners who don't yet grasp the basics. The notes are also too brief for those wanting to learn the math behind LLMs. I hope this can help you improve the tutorial.

In this post