Fast Beam Search Decoding in PyTorch with TorchAudio and Flashlight Text Blog Fast Beam Search Decoding in PyTorch with TorchAudio and Flashlight Text Beam search decoding with industry-leading speed from Flashlight Text (part of the Flashlight ML framework) is now available with…Caroline Chen, Jacob Kahn (@jacob_d_kahn)August 29, 2022
Introducing nvFuser, a deep learning compiler for PyTorch Blog Introducing nvFuser, a deep learning compiler for PyTorch nvFuser is a Deep Learning Compiler for NVIDIA GPUs that automatically just-in-time compiles fast and…Christian Sarofeen, Piotr Bialecki, Jie Jiang, Kevin Stephano, Masaki Kozuki, Neal Vaidya, Stas BekmanAugust 26, 2022
Accelerating PyTorch Vision Models with Channels Last on CPU Blog Accelerating PyTorch Vision Models with Channels Last on CPU Overview Memory formats has significant impact on performance when running vision models, generally Channels Last…Mingfei Ma (Intel), Vitaly Fedyunin (Meta), Wei Wei (Meta)August 24, 2022
Easily list and initialize models with new APIs in TorchVision Blog Easily list and initialize models with new APIs in TorchVision TorchVision now supports listing and initializing all available built-in models and weights by name. This…Vasilis Vryniotis and Laurence RouesnelAugust 18, 2022
Empowering PyTorch on Intel® Xeon® Scalable processors with Bfloat16 Blog Empowering PyTorch on Intel® Xeon® Scalable processors with Bfloat16 Overview Recent years, the growing complexity of AI models have been posing requirements on hardware…Mingfei Ma (Intel), Vitaly Fedyunin (Meta), Wei Wei (Meta)August 16, 2022
Introducing the PlayTorch app: Rapidly Create Mobile AI Experiences Blog Introducing the PlayTorch app: Rapidly Create Mobile AI Experiences In December, we announced PyTorch Live, a toolkit for building AI-powered mobile prototypes in minutes.…PlayTorch TeamJuly 22, 2022
What Every User Should Know About Mixed Precision Training in PyTorch Blog What Every User Should Know About Mixed Precision Training in PyTorch Efficient training of modern neural networks often relies on using lower precision data types. Peak…Syed Ahmed, Christian Sarofeen, Mike Ruberry, Eddie Yan, Natalia Gimelshein, Michael Carilli, Szymon Migacz, Piotr Bialecki, Paulius Micikevicius, Dusan Stosic, Dong Yang, and Naoya MaruyamaJuly 19, 2022
Case Study: PathAI Uses PyTorch to Improve Patient Outcomes with AI-powered Pathology Blog Case Study: PathAI Uses PyTorch to Improve Patient Outcomes with AI-powered Pathology PathAI is the leading provider of AI-powered technology tools and services for pathology (the study of…Logan Kilpatrick - Sr. Technology Advocate, Harshith Padigela - ML Engineer, Syed Ashar Javed - ML Technical Lead, Robert Egger - Biomedical Data ScientistJuly 15, 2022
A BetterTransformer for Fast Transformer Inference Blog A BetterTransformer for Fast Transformer Inference tl;dr Transformers achieve state-of-the-art performance for NLP, and are becoming popular for a myriad of other…Michael Gschwind, Eric Han, Scott Wolchok, Rui Zhu, Christian PuhrschJuly 12, 2022
PyTorch 1.12: TorchArrow, Functional API for Modules and nvFuser, are now available Blog PyTorch 1.12: TorchArrow, Functional API for Modules and nvFuser, are now available We are excited to announce the release of PyTorch 1.12 (release note)! This release is…PyTorch FoundationJune 28, 2022
New library updates in PyTorch 1.12 Blog New library updates in PyTorch 1.12 We are bringing a number of improvements to the current PyTorch libraries, alongside the PyTorch 1.12…PyTorch FoundationJune 28, 2022
How Computational Graphs are Executed in PyTorch Blog How Computational Graphs are Executed in PyTorch Welcome to the last entry into understanding the autograd engine of PyTorch series! If you…Preferred NetworksJune 27, 2022
Geospatial deep learning with TorchGeo Blog Geospatial deep learning with TorchGeo TorchGeo is a PyTorch domain library providing datasets, samplers, transforms, and pre-trained models specific to…Adam Stewart (University of Illinois at Urbana-Champaign), Caleb Robinson (Microsoft AI for Good Research Lab), Isaac Corley (University of Texas at San Antonio)June 23, 2022
How Disney Improved Activity Recognition Through Multimodal Approaches with PyTorch Blog How Disney Improved Activity Recognition Through Multimodal Approaches with PyTorch Introduction Among the many things Disney Media & Entertainment Distribution (DMED) is responsible for, is…Monica Alfaro, Albert Aparicio, Francesc Guitart, Marc Junyent, Pablo Pernias, Marcel Porta, and Miquel Àngel Farré (former Senior Technology Manager)June 16, 2022
Introducing Accelerated PyTorch Training on Mac Blog Introducing Accelerated PyTorch Training on Mac In collaboration with the Metal engineering team at Apple, we are excited to announce support…PyTorchMay 18, 2022
Ambient Clinical Intelligence: Generating Medical Reports with PyTorch Blog Ambient Clinical Intelligence: Generating Medical Reports with PyTorch Introduction Complete and accurate clinical documentation is an essential tool for tracking patient care. It…Miguel Del-Agua, Principal Research Scientist, Nuance and Jeremy Jancsary, Senior Principal Research Scientist, NuanceMay 12, 2022
Running PyTorch Models on Jetson Nano Blog Running PyTorch Models on Jetson Nano Overview NVIDIA Jetson Nano, part of the Jetson family of products or Jetson modules, is a small yet…Jeff Tang, Hamid Shojanazeri, Geeta ChauhanMarch 16, 2022
Introducing PyTorch Fully Sharded Data Parallel (FSDP) API Blog Introducing PyTorch Fully Sharded Data Parallel (FSDP) API Recent studies have shown that large model training will be beneficial for improving model quality.…Yanli Zhao, Rohan Varma, Chien-Chin Huang, Shen Li, Min Xu, Alban DesmaisonMarch 14, 2022
PyTorch 1.11, TorchData, and functorch are now available Blog PyTorch 1.11, TorchData, and functorch are now available We are excited to announce the release of PyTorch 1.11 (release notes). This release is…PyTorch FoundationMarch 10, 2022
Introducing TorchRec, and other domain library updates in PyTorch 1.11 Blog Introducing TorchRec, and other domain library updates in PyTorch 1.11 We are introducing the beta release of TorchRec and a number of improvements to the…PyTorch FoundationMarch 10, 2022