Real-time Audio-visual Speech Recognition Blog Real-time Audio-visual Speech Recognition Audio-Visual Speech Recognition (AV-ASR, or AVSR) is the task of transcribing text from audio and…PyTorch FoundationOctober 10, 2023
PyTorch 2.1: automatic dynamic shape compilation, distributed checkpointing Blog PyTorch 2.1: automatic dynamic shape compilation, distributed checkpointing We are excited to announce the release of PyTorch® 2.1 (release note)! PyTorch 2.1 offers…PyTorch FoundationOctober 4, 2023
New Library Updates in PyTorch 2.1 Blog New Library Updates in PyTorch 2.1 Summary We are bringing a number of improvements to the current PyTorch libraries, alongside the…PyTorch FoundationOctober 4, 2023
High performance Llama 2 deployments with AWS Inferentia2 using TorchServe Blog High performance Llama 2 deployments with AWS Inferentia2 using TorchServe Recently, Llama 2 was released and has attracted a lot of interest from the machine learning community. Amazon…Mike Zhang, Li Ning, Sergey Ivanov, Naman Nandan, Hamid Shojanazeri, Geeta Chauhan, Abhi Shivaditya, Michael Nguyen, Pinak PanigrahiOctober 4, 2023
How to Build an Interactive Chat-Generation Model using DialoGPT and PyTorch Blog How to Build an Interactive Chat-Generation Model using DialoGPT and PyTorch The focus on interactive chat-generation (or conversational response-generation) models has greatly increased in the past…IntelOctober 3, 2023
Announcing PyTorch Docathon H2 2023 Announcements Announcing PyTorch Docathon H2 2023 We are excited to announce that we will be holding a Docathon for PyTorch on…PyTorch FoundationOctober 2, 2023
Inside the Matrix: Visualizing Matrix Multiplication, Attention and Beyond Blog Inside the Matrix: Visualizing Matrix Multiplication, Attention and Beyond Use 3D to visualize matrix multiplication expressions, attention heads with real weights, and more. Matrix…Basil HosmerSeptember 25, 2023
Accelerated CPU Inference with PyTorch Inductor using torch.compile Blog Accelerated CPU Inference with PyTorch Inductor using torch.compile Story at a Glance Although the PyTorch* Inductor C++/OpenMP* backend has enabled users to take…IntelSeptember 13, 2023
One Year of PyTorch Foundation Announcements One Year of PyTorch Foundation It’s been one year since we announced the formation of the PyTorch Foundation! 🎉 In…PyTorch FoundationSeptember 12, 2023
Graphcore Joins the PyTorch Foundation as a General Member Announcements Graphcore Joins the PyTorch Foundation as a General Member The PyTorch Foundation, a neutral home for the deep learning community to collaborate on the…PyTorch FoundationSeptember 6, 2023
Automated trace collection and analysis Blog Automated trace collection and analysis In this blog, we share how we enabled the collection and analysis of PyTorch Profiler…Anupam Bhatnagar, Brian CoutinhoSeptember 5, 2023
PyTorch/XLA SPMD: Scale Up Model Training and Serving with Automatic Parallelization Blog PyTorch/XLA SPMD: Scale Up Model Training and Serving with Automatic Parallelization Today, we are delighted to announce PyTorch/XLA SPMD: the integration of GSPMD into PyTorch with an easy…Yeounoh Chung, Jon Bolin, Milad Mohammadi, Jiewen Tan, Jack Cao, Joe Spisak, Alex Spiridonov, Shauheen Zahirazami, Steven Krawczyk, Wonjoo Lee Mohit Khatwani, Wanchao Liang, Vaibhav SinghAugust 31, 2023
Large Scale Training of Hugging Face Transformers on TPUs With PyTorch/XLA FSDP Blog Large Scale Training of Hugging Face Transformers on TPUs With PyTorch/XLA FSDP AI is transforming many industries through advanced capabilities such as understanding and generating language, answering…Alex Wertheim, Milad Mohammadi, Jack Cao, Alex Spiridonov, Joe Spisak, Lysandre Debut, Sylvain Gugger, Sourab MangrulkarAugust 24, 2023
Intel Joins the PyTorch Foundation as a Premier Member Announcements Intel Joins the PyTorch Foundation as a Premier Member The PyTorch Foundation, a neutral home for the deep learning community to collaborate on the…PyTorch FoundationAugust 10, 2023
INT8 Quantization for x86 CPU in PyTorch Blog INT8 Quantization for x86 CPU in PyTorch Overview INT8 quantization is a powerful technique for speeding up deep learning inference on x86…IntelAugust 7, 2023
Hugging Face Joins the PyTorch Foundation as a Premier Member Announcements Hugging Face Joins the PyTorch Foundation as a Premier Member The PyTorch Foundation, a neutral home for the deep learning community to collaborate on the…PyTorch FoundationAugust 3, 2023
AMD’s Journey to Openness and Performance Announcements AMD’s Journey to Openness and Performance AMD has gained progress in building a robust software stack that supports an open ecosystem…PyTorch FoundationAugust 1, 2023
Performant Distributed checkpointing in Production with IBM Announcements Performant Distributed checkpointing in Production with IBM Last year, IBM Research began collaborating with us to onboard Fully Sharded Data Parallelism (FSDP)…Meta: Iris Zhang, Less Wright, Rodrigo Kumpera, Chien-Chin Huang, IBM: Davis Wertheimer, Supriyo Chakraboty, Sophia Wen, Raghu Ganti, Mudhakar Srivatsa, Seethrami SeelamJuly 31, 2023
IBM Joins the PyTorch Foundation as a Premier Member Announcements IBM Joins the PyTorch Foundation as a Premier Member The PyTorch Foundation, part of The Linux Foundation, is pleased to announce that IBM has…PyTorch FoundationJuly 27, 2023
Announcing CPP-based S3 IO DataPipes Blog Announcing CPP-based S3 IO DataPipes Training large deep learning models requires large datasets. Amazon Simple Storage Service (Amazon S3) is a scalable…John He, Khaled ElGalaind, Roshani Nagmote, Daiming YangJuly 25, 2023