October 02, 2023
Announcing PyTorch Docathon H2 2023
We are excited to announce that we will be holding a Docathon for PyTorch on November 1, 2023! This event is an opportunity for our community to come together and improve the quality of our documentation.
September 25, 2023
Inside the Matrix: Visualizing Matrix Multiplication, Attention and Beyond
Use 3D to visualize matrix multiplication expressions, attention heads with real weights, and more.
September 13, 2023
Accelerated CPU Inference with PyTorch Inductor using torch.compile
Story at a Glance
September 12, 2023
One Year of PyTorch Foundation
It’s been one year since we announced the formation of the PyTorch Foundation! 🎉
September 05, 2023
Automated trace collection and analysis
In this blog, we share how we enabled the collection and analysis of PyTorch Profiler traces for training workloads without any user side code instrumentation. We leveraged Dynolog - an open source daemon for CPU and GPU telemetry to collect PyTorch Profiler traces, and analyzed the collected traces using Holistic Trace Analysis - an open source library for analyzing PyTorch Profiler traces. This toolchain has allowed engineers at Meta to accelerate their performance optimization workflows. T...
August 31, 2023
PyTorch/XLA SPMD: Scale Up Model Training and Serving with Automatic Parallelization
Today, we are delighted to announce PyTorch/XLA SPMD: the integration of GSPMD into PyTorch with an easy to use API. PyTorch developers seeking superior performance and scale can train and serve the largest neural networks while maximizing utilization of AI accelerators, such as Google Cloud TPUs.
