PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models Blog PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models In this blog post, we describe the first peer-reviewed research paper that explores accelerating the…Chaoyang He, Shen Li, Mahdi Soltanolkotabi, and Salman AvestimehrAugust 18, 2021
University of Pécs enables text and speech processing in Hungarian, builds the BERT-large model with just 1,000 euro with Azure Case Studies University of Pécs enables text and speech processing in Hungarian, builds the BERT-large model with just 1,000 euro with Azure Everyone prefers to use their mother tongue when communicating with chat agents and other automated…PyTorch FoundationAugust 10, 2021
What’s New in PyTorch Profiler 1.9? Blog What’s New in PyTorch Profiler 1.9? PyTorch Profiler v1.9 has been released! The goal of this new release (previous PyTorch Profiler release)…Sabrina Smai, Program Manager on the AI Framework team at MicrosoftAugust 3, 2021
Everything You Need To Know About Torchvision’s SSDlite Implementation Blog Everything You Need To Know About Torchvision’s SSDlite Implementation In the previous article, we’ve discussed how the SSD algorithm works, covered its implementation details and…Vasilis VryniotisJune 27, 2021
The torch.linalg module: Accelerated Linear Algebra with Autograd in PyTorch Blog The torch.linalg module: Accelerated Linear Algebra with Autograd in PyTorch Linear algebra is essential to deep learning and scientific computing, and it’s always been a…Mike Ruberry, Ivan Yashchuk, Xiao Wang, Mario Lezcano and Natalia GimelsheinJune 23, 2021
An Overview of the PyTorch Mobile Demo Apps Blog An Overview of the PyTorch Mobile Demo Apps PyTorch Mobile provides a runtime environment to execute state-of-the-art machine learning models on mobile devices.…Jeff Tang and Mark SaroufimJune 18, 2021
How 3DFY.ai Built a Multi-Cloud, Distributed Training Platform Over Spot Instances with TorchElastic and Kubernetes Case Studies How 3DFY.ai Built a Multi-Cloud, Distributed Training Platform Over Spot Instances with TorchElastic and Kubernetes Deep Learning development is becoming more and more about minimizing the time from idea to…PyTorch FoundationJune 17, 2021
Everything You Need To Know About Torchvision’s SSD Implementation Blog Everything You Need To Know About Torchvision’s SSD Implementation In TorchVision v0.10, we’ve released two new Object Detection models based on the SSD architecture.…Vasilis VryniotisJune 16, 2021
New PyTorch Library Releases in PyTorch 1.9, including TorchVision, TorchAudio, and more Blog New PyTorch Library Releases in PyTorch 1.9, including TorchVision, TorchAudio, and more Today, we are announcing updates to a number of PyTorch libraries, alongside the PyTorch 1.9 release.…PyTorch FoundationJune 15, 2021
PyTorch 1.9 Release, including torch.linalg and Mobile Interpreter Blog PyTorch 1.9 Release, including torch.linalg and Mobile Interpreter We are excited to announce the release of PyTorch 1.9. The release is composed of…PyTorch FoundationJune 15, 2021
Overview of PyTorch Autograd Engine Blog Overview of PyTorch Autograd Engine This blog post is based on PyTorch version 1.8, although it should apply for older…Preferred Networks, Inc.June 8, 2021
AI21 Labs Trains 178-Billion-Parameter Language Model Using Amazon EC2 P4d Instances, PyTorch Case Studies AI21 Labs Trains 178-Billion-Parameter Language Model Using Amazon EC2 P4d Instances, PyTorch AI21 Labs uses machine learning to develop language models focused on understanding meaning, and in…PyTorch FoundationJune 7, 2021
PyTorch Community Voices Case Studies PyTorch Community Voices Join us for an interview with star PyTorch community members Alexander O’Connor and Binghui Ouyang…PyTorch FoundationJune 2, 2021
Everything you need to know about TorchVision’s MobileNetV3 implementation Blog Everything you need to know about TorchVision’s MobileNetV3 implementation In TorchVision v0.9, we released a series of new mobile-friendly models that can be used for Classification,…Vasilis Vryniotis and Francisco MassaMay 26, 2021
Announcing the PyTorch Enterprise Support Program Blog Announcing the PyTorch Enterprise Support Program Today, we are excited to announce the PyTorch Enterprise Support Program, a participatory program that…PyTorch FoundationMay 25, 2021
How Outreach Productionizes PyTorch-based Hugging Face Transformers for NLP Case Studies How Outreach Productionizes PyTorch-based Hugging Face Transformers for NLP At Outreach, a leading sales engagement platform, our data science team is a driving force…PyTorch FoundationMay 14, 2021
PyTorch Ecosystem Day 2021 Recap and New Contributor Resources Blog PyTorch Ecosystem Day 2021 Recap and New Contributor Resources Thank you to our incredible community for making the first ever PyTorch Ecosystem Day a…PyTorch FoundationMay 10, 2021
Automated Background Removal in E-commerce Fashion Image Processing Using PyTorch on Databricks Case Studies Automated Background Removal in E-commerce Fashion Image Processing Using PyTorch on Databricks Wehkamp is one of the biggest e-commerce companies in the Netherlands, with more than 500,000…PyTorch FoundationApril 29, 2021
Disney’s Creative Genome by Miquel Farré Case Studies Disney’s Creative Genome by Miquel Farré Miquel Farré is a senior technology manager at Disney, taking the lead on projects at…PyTorch FoundationApril 27, 2021
An overview of the ML models introduced in TorchVision v0.9 Blog An overview of the ML models introduced in TorchVision v0.9 TorchVision v0.9 has been released and it is packed with numerous new Machine Learning models and features,…PyTorch FoundationApril 16, 2021