Blog
Thoughts on AI research, program management, and building products.
The fp8 Mirage: Reverse-Engineering Apple's M4 Max Tensor Path
Apple shipped a tensor matmul in Metal 4.1 and documented almost nothing about how it actually behaves on the M4 Max. So I measured it. Eleven hidden specifications later, the headline is uncomfortable: the fp8 path is emulated, not accelerated — and that turns out to be the most useful thing you can know before you write a single kernel.
What If LLMs Had Life? The Strange, Sobering Lessons of UYIR
I spent six months trying to make a language model evolve — to give it a population of adapters that compete, die, reproduce, and pass knowledge to their neighbors. The data did not love the story I wanted to tell. This is what it told me instead, why I am writing it down anyway, and where I want to take this next.
Orion: Programming Apple's Neural Engine for LLM Training (Not Just Inference)
Two billion Apple devices ship with a dedicated neural accelerator that's been sitting almost entirely dark. CoreML is the only public way in, and it doesn't support training. Orion is what happens when you decide that's not an acceptable answer.