Yi Cui
onekq
AI & ML interests
Benchmark, Code Generation Model
Recent Activity
replied to
their
post
about 3 hours ago
I am starting a new series on matrix. The idea came to me when I wrote about the Muon optimizer.
Matrix itself has lots of fascinating properties and is applied in STEM fields for many decades. Its application in ML is just the beginning. There are lots of low hanging fruits. At the very least, I hope this math perspective will give you a new lens.
https://huggingface.co/blog/onekq/matrices-transformers-preface
posted
an
update
about 12 hours ago
I am starting a new series on matrix. The idea came to me when I wrote about the Muon optimizer.
Matrix itself has lots of fascinating properties and is applied in STEM fields for many decades. Its application in ML is just the beginning. There are lots of low hanging fruits. At the very least, I hope this math perspective will give you a new lens.
https://huggingface.co/blog/onekq/matrices-transformers-preface
published
an
article
1 day ago
🔀 Matrices in Transformers: Preface
Organizations
