Blog

Generalized Dot-Product Attention: Tackling Real-World Challenges in GPU Training Kernels Blog

Generalized Dot-Product Attention: Tackling Real-World Challenges in GPU Training Kernels

In this blog post, we present the kernel design of Generalized Dot-Product Attention (GDPA), a…
Jackie (Jiaqi) Xu, Chao Chen, Shuqi Yang, Markus Hoehnerbach, Xiaoyi (Leo) Liu, Ted Zadouri‡, Dev (Devashish) Shankar, Jacky Zhou, Hongtao Yu, Manman Ren, Han Xu, Chunzhi Yang†, Jade Nie†, Haoyu Zhang, Huayu Li, Michael Shu, Musharaf Sultan, Max Leung, John Bocharov, Tri Dao‡
March 18, 2026
Building Voice Agents with ExecuTorch: A Cross-Platform Foundation for On-Device Audio Blog

Building Voice Agents with ExecuTorch: A Cross-Platform Foundation for On-Device Audio

TL;DR Open source voice models are proliferating, but there's no unified native inference platform for…
Mergen Nachin, Manuel Candales, Mengwei Liu, Jacob Szwejbka, Young Han, Songhao Jia, Stephen Jia, Scott Roy, Alban Desmaison, Hansong Zhang from PyTorch Team at Meta; Yagil Burowski, Matt Clayton, Will Burford from LM Studio
March 15, 2026