Introducing PyTorch Fully Sharded Data Parallel (FSDP) API Blog Introducing PyTorch Fully Sharded Data Parallel (FSDP) API Recent studies have shown that large model training will be beneficial for improving model quality.…Yanli Zhao, Rohan Varma, Chien-Chin Huang, Shen Li, Min Xu, Alban DesmaisonMarch 14, 2022
PyTorch 1.11, TorchData, and functorch are now available Blog PyTorch 1.11, TorchData, and functorch are now available We are excited to announce the release of PyTorch 1.11 (release notes). This release is…PyTorch FoundationMarch 10, 2022
Introducing TorchRec, and other domain library updates in PyTorch 1.11 Blog Introducing TorchRec, and other domain library updates in PyTorch 1.11 We are introducing the beta release of TorchRec and a number of improvements to the…PyTorch FoundationMarch 10, 2022
Create a Wine Recommender Using NLP on AWS Case Studies Create a Wine Recommender Using NLP on AWS In this tutorial, we’ll build a simple machine learning pipeline using a BERT word embedding…PyTorch FoundationMarch 2, 2022
Understanding LazyTensor System Performance with PyTorch/XLA on Cloud TPU Blog Understanding LazyTensor System Performance with PyTorch/XLA on Cloud TPU Introduction Ease of use, expressivity, and debuggability are among the core principles of PyTorch. One…Vaibhav SinghMarch 2, 2022
Amazon Ads Uses PyTorch and AWS Inferentia to Scale Models for Ads Processing Case Studies Amazon Ads Uses PyTorch and AWS Inferentia to Scale Models for Ads Processing Amazon Ads uses PyTorch, TorchServe, and AWS Inferentia to reduce inference costs by 71% and…PyTorch FoundationFebruary 24, 2022
Case Study: Amazon Ads Uses PyTorch and AWS Inferentia to Scale Models for Ads Processing Blog Case Study: Amazon Ads Uses PyTorch and AWS Inferentia to Scale Models for Ads Processing Amazon Ads uses PyTorch, TorchServe, and AWS Inferentia to reduce inference costs by 71% and…Yashal Kanungo – Applied Scientist, Kamran Khan - Sr. Technical Product Manager, Shubha Kumbadakone – Sr. Specialist, ML FrameworksFebruary 24, 2022
Introducing TorchRec, a library for modern production recommendation systems Blog Introducing TorchRec, a library for modern production recommendation systems We are excited to announce TorchRec, a PyTorch domain library for Recommendation Systems. This new library…Meta AI - Donny Greenberg, Colin Taylor, Dmytro Ivchenko, Xing Liu, Anirudh SudarshanFebruary 23, 2022
ChemicalX: A Deep Learning Library for Drug Pair Scoring Case Studies ChemicalX: A Deep Learning Library for Drug Pair Scoring In this paper, we introduce ChemicalX, a PyTorch-based deep learning library designed for providing a…PyTorch FoundationFebruary 10, 2022
Practical Quantization in PyTorch Blog Practical Quantization in PyTorch Quantization is a cheap and easy way to make your DNN run faster and with…Suraj Subramanian, Mark Saroufim, Jerry ZhangFebruary 8, 2022
The Why and How of Scaling Large Language Models Case Studies The Why and How of Scaling Large Language Models Anthropic is an AI safety and research company that’s working to build reliable, interpretable, and…PyTorch FoundationJanuary 4, 2022
Introducing TorchVision’s New Multi-Weight Support API Blog Introducing TorchVision’s New Multi-Weight Support API TorchVision has a new backwards compatible API for building models with multi-weight support. The new…Vasilis VryniotisDecember 22, 2021
Efficient PyTorch: Tensor Memory Format Matters Blog Efficient PyTorch: Tensor Memory Format Matters Ensuring the right memory format for your inputs can significantly impact the running time of…Dhruv Matani, Suraj SubramanianDecember 15, 2021
Announcing the Winners of the 2021 PyTorch Annual Hackathon Blog Announcing the Winners of the 2021 PyTorch Annual Hackathon More than 1,900 people worked hard in this year’s PyTorch Annual Hackathon to create unique…PyTorch FoundationDecember 8, 2021
Running BERT model inference on AWS Inf1: From model compilation to speed comparison Case Studies Running BERT model inference on AWS Inf1: From model compilation to speed comparison In this tech blog, we will compare the speed and cost of Inferentia, GPU, and…PyTorch FoundationNovember 21, 2021
How to Train State-Of-The-Art Models Using TorchVision’s Latest Primitives Blog How to Train State-Of-The-Art Models Using TorchVision’s Latest Primitives A few weeks ago, TorchVision v0.11 was released packed with numerous new primitives, models and…Vasilis VryniotisNovember 18, 2021
SearchSage: Learning Search Query Representations at Pinterest Case Studies SearchSage: Learning Search Query Representations at Pinterest Pinterest surfaces billions of ideas to people every day, and the neural modeling of embeddings…PyTorch FoundationNovember 9, 2021
Feature Extraction in TorchVision using Torch FX Blog Feature Extraction in TorchVision using Torch FX Introduction FX based feature extraction is a new TorchVision utility that lets us access intermediate transformations of an…Alexander Soare and Francisco MassaOctober 29, 2021
Accelerating PyTorch with CUDA Graphs Blog Accelerating PyTorch with CUDA Graphs Today, we are pleased to announce a new advanced CUDA feature, CUDA Graphs, has been…Vinh Nguyen, Michael Carilli, Sukru Burc Eryilmaz, Vartika Singh, Michelle Lin, Natalia Gimelshein, Alban Desmaison, Edward YangOctober 26, 2021
PyTorch 1.10 Release, including CUDA Graphs APIs, Frontend and Compiler Improvements Blog PyTorch 1.10 Release, including CUDA Graphs APIs, Frontend and Compiler Improvements We are excited to announce the release of PyTorch 1.10. This release is composed of…PyTorch FoundationOctober 21, 2021