Blog

Blog

Accelerating Mamba2 with Kernel Fusion

Summary In this post, we discuss how we optimized the Mamba-2 State-Space Dual (SSD) module…

Rishi Astra, Tri Dao, Adnan HoqueFebruary 6, 2026

Blog

Some Matrix Multiplication Engines Are Not As Accurate As We Thought

What is an accumulator in an accelerator's GEMM engine and why does it matter? GPUs…

Chi-Chun (Charlie) Liu, Monodeep Kar, Naigang Wang, Raghu Kiran Ganti, Mudhakar SrivatsaFebruary 6, 2026

Blog

Building Highly Efficient Inference System for Recommenders Using PyTorch

Why Choose PyTorch for Recommendation System PyTorch has emerged as the de facto framework in…

Lu Fang, Shiyan Deng, Hongyi Jia, Huamin Li, Ilina Mitra, Sheng Qin, Zhengkai Zhang, Zhuoran Zhao, Zinnia ZhengFebruary 5, 2026

Blog

Portable Paged Attention in Helion

Recently, the PyTorch team released Helion, a new domain-specific and PyTorch-based language to make the…

Burkhard Ringlein (IBM Research) and the vLLM Team at IBM ResearchFebruary 3, 2026

Blog Community

Unlock Reasoning in Llama 3.1-8B via Full Fine-Tuning on NVIDIA DGX Spark

What is the unsaid joy of local LLMs? The magic of downloading weights, running some…

Sanyam Bhutani (PyTorch Meta), Hamid Shojanazeri (PyTorch Meta), Clement Anthonioz Blanc (Meta)February 2, 2026

Blog

Accelerating On-Device ML Inference with ExecuTorch and Arm SME2

Interactive image segmentation has become a defining mobile experience across the world’s most popular apps.…

Jason Zhu, Tyler Mullenbach, Damien Dooley, and Gian Marco Idoice, ArmJanuary 29, 2026

Announcements

Feast Joins the PyTorch Ecosystem: Bridging Feature Stores and Deep Learning

PyTorch revolutionized how we build and serve AI models, but getting them to production remains…

Francisco Javier Arceo, Hao Xu, Shuchu HanJanuary 22, 2026

Blog

PyTorch 2.10 Release Blog

We are excited to announce the release of PyTorch® 2.10 (release notes)! This release features…

PyTorch FoundationJanuary 21, 2026

Announcements

PyTorch Conference Europe 2026 Comes to Paris – Call for Proposals Now Open

Join the global PyTorch community in Paris, France, on 7–8 April 2026 for two days…

PyTorch FoundationJanuary 20, 2026

Announcements Blog

PyTorch Foundation in 2025: A Year in Review and the Road Ahead

2025 was a defining year for PyTorch Foundation. In May, we announced our expansion into…

PyTorch FoundationJanuary 15, 2026

Blog

Supercharging LLMs: Scalable RL with torchforge and Weaver

Scaling reinforcement learning (RL) for post-training large language models (LLMs) is notoriously difficult. While running…

Stanford - Jon Saad-Falcon, Hangoo Kang, Simon Guo, Aakanksha Chowdhery, Azalia Mirhoseini Meta - Allen Wang, Danning Xie, Evan Smothers, Felipe Mello, Jack Khuu, Jiyue Wang, Joe Cummings, Lucas Pasqualin, Philip Bontrager, Rithesh Baradi, Vidhya Venkat, Yuxuan Hu, Jafar Taghiyar, Davide Italiano, Gayathri Aiyer, John Myles White, Joe Spisak, Sanyam Bhutani, Hamid Shojanazeri, Matthias Reso Ali Sol Hossein Kavianihamedani Emre Guven CoreWeave - Deok Filho Aaron Batilo Matthew Guan Xi LuJanuary 9, 2026

Blog

Warp Specialization in Triton: Design and Roadmap

The Triton compiler aims to generate performance-portable code and runtime across hardware for AI kernels.…

Manman Ren, Nick Riasanovsky, Neil Dhar, Hongtao Yu, Jie Liu, Partha Kanuparthy, Shane NayJanuary 8, 2026

Announcements

PyTorch Day India 2026: Registration Now Open

PyTorch Day India 2026 brings the PyTorch community to Bengaluru on 7 February 2026. Hosted…

PyTorch FoundationJanuary 8, 2026

Blog

PyTorch 2.9: FlexAttention Optimization Practice on Intel GPUs

Overview The most recent LLM serving frameworks and models increasingly adopt attention variants, such as…

Intel PyTorch and Triton teamJanuary 8, 2026

Blog

Deploying Smarter: Hardware-Software Co-design in PyTorch

If you want powerful on-device AI that doesn’t blow your memory budget or turn your…

Kieran Hejmadi, ArmDecember 18, 2025

Blog

Enabling Cluster Launch Control with TLX

What is cluster launch control (CLC)? Blackwell brings in cluster launch control (CLC) to enable…

Daohang Shi, Hongtao Yu, Manman RenDecember 17, 2025

Announcements Blog

PyTorch Ecosystem Working Group Update & Project Spotlights, Q4 2025

As part of this blog series, we share updates on new projects joining the PyTorch…

PyTorch Ecosystem Working GroupDecember 17, 2025

Announcements Blog

PyTorch Foundation at NeurIPS 2025: PyTorch Community Highlights, Sessions, & Takeaways

NeurIPS 2025 brought together researchers, engineers, maintainers, and ecosystem contributors from across the AI community.…

PyTorch FoundationDecember 16, 2025

Announcements

NeuralOperatorJoins the PyTorch Ecosystem: Learning in Infinite Dimension with Neural Operators

Today, we are pleased to welcome NeuralOperator to the PyTorch Ecosystem as a dedicated library…

Jean Kossaifi, David Pitt, Valentin Duruisseaux, Anima AnandkumarDecember 12, 2025

Announcements

Celebrating the 2025 PyTorch Startup Showcase Winners

Runhouse (Winner) and CuraVoice (Community Choice Award) The 2025 PyTorch Startup Showcase highlighted early-stage teams…

PyTorch FoundationDecember 3, 2025

Accelerating Mamba2 with Kernel Fusion

Some Matrix Multiplication Engines Are Not As Accurate As We Thought

Building Highly Efficient Inference System for Recommenders Using PyTorch

Portable Paged Attention in Helion

Unlock Reasoning in Llama 3.1-8B via Full Fine-Tuning on NVIDIA DGX Spark

Accelerating On-Device ML Inference with ExecuTorch and Arm SME2

Feast Joins the PyTorch Ecosystem: Bridging Feature Stores and Deep Learning

PyTorch 2.10 Release Blog

PyTorch Conference Europe 2026 Comes to Paris – Call for Proposals Now Open

PyTorch Foundation in 2025: A Year in Review and the Road Ahead

Supercharging LLMs: Scalable RL with torchforge and Weaver

Warp Specialization in Triton: Design and Roadmap

PyTorch Day India 2026: Registration Now Open

PyTorch 2.9: FlexAttention Optimization Practice on Intel GPUs

Deploying Smarter: Hardware-Software Co-design in PyTorch

Enabling Cluster Launch Control with TLX

PyTorch Ecosystem Working Group Update & Project Spotlights, Q4 2025

PyTorch Foundation at NeurIPS 2025: PyTorch Community Highlights, Sessions, & Takeaways

NeuralOperatorJoins the PyTorch Ecosystem: Learning in Infinite Dimension with Neural Operators

Celebrating the 2025 PyTorch Startup Showcase Winners

Docs

Tutorials

Resources

Stay in touch for updates, event info, and the latest news