Right now, I'm in love with LLM inference. Especially kernel engineering (CUDA, Metal, Triton, etc.).
gpt-2prefilldecode
tokens
Thecatsat?
→
blocks
attnffn
attnffn
attnffn
×12
→
lm head
theonmat
Beside LLM, I'm also interested in mathematics (Optimization) and some theoretical ML stuffs (Bayesian, Learning Dynamics, Reinforcement Learning, etc.).
One of my favorite things is to learn new things and share them with others (that is the main reason why I started this blog). I also like to build things from scratch.
I also love to spend time with my family and my friends.