Accelerating Large Language Models with Accelerated Transformers Blog Accelerating Large Language Models with Accelerated Transformers TL;DR. We show how to use Accelerated PyTorch 2.0 Transformers and the newly introduced torch.compile() method to accelerate…Lucas Pasqualin, Driss Guessous, Christian Puhrsch, Bertrand Maher, Michael GschwindApril 19, 2023
Experience the power of PyTorch 2.0 on AMD Solutions Blog Experience the power of PyTorch 2.0 on AMD Solutions PyTorch 2.0 represents a significant step forward for the PyTorch machine learning framework. The stable…AMDApril 15, 2023
Accelerated Generative Diffusion Models with PyTorch 2 Blog Accelerated Generative Diffusion Models with PyTorch 2 TL;DR: PyTorch 2.0 nightly offers out-of-the-box performance improvement for Generative Diffusion models by using the…Grigory Sizov, Michael Gschwind, Hamid Shojanazeri, Driss Guessous, Daniel Haziza, Christian PuhrschApril 14, 2023
Straggler Mitigation On PyTorch DDP By Hierarchical SGD Blog Straggler Mitigation On PyTorch DDP By Hierarchical SGD PyTorch DDP has been widely adopted across the industry for distributed training, which by default runs…Yi Wang (Cruise AI), Rohan Varma (Meta AI)April 7, 2023
Celebrate PyTorch 2.0 with New Performance Features for AI Developers Blog Celebrate PyTorch 2.0 with New Performance Features for AI Developers Congratulations to the PyTorch Foundation for its release of PyTorch 2.0! In this blog, I discuss…IntelApril 7, 2023
Profiling PyTorch language models with octoml-profile Community Profiling PyTorch language models with octoml-profile The recent launch of PyTorch 2.0 makes it clear that the community is heavily investing…Team OctoApril 4, 2023
PyTorch & OpenXLA: The Path Forward Blog PyTorch & OpenXLA: The Path Forward As we celebrate the release of OpenXLA, PyTorch 2.0, and PyTorch/XLA 2.0, it’s worth taking a step back…Milad Mohammadi, Jack Cao, Shauheen Zahirazami, Joe Spisak, and Jiewen TanApril 3, 2023
Accelerated PyTorch 2 Transformers Blog Accelerated PyTorch 2 Transformers The PyTorch 2.0 release includes a new high-performance implementation of the PyTorch Transformer API with…Michael Gschwind, Driss Guessous, Christian PuhrschMarch 28, 2023
PyTorch 2.0 & XLA—The Latest Cutting Edge Features Blog PyTorch 2.0 & XLA—The Latest Cutting Edge Features Today, we are excited to share our latest work for PyTorch/XLA 2.0. The release of PyTorch 2.0 is…Jack Cao, Milad Mohammadi, Alex Wertheim, Yeounoh Chung, Joe Spisak, Will Cromar, Shauheen ZahirazamiMarch 22, 2023
Accelerated Diffusers with PyTorch 2.0 Blog Accelerated Diffusers with PyTorch 2.0 PyTorch 2.0 has just been released. Its flagship new feature is torch.compile(), a one-line code change…Pedro Cuenca, Patrick von Platen, Suraj Patil, Sayak PaulMarch 16, 2023
PyTorch 2.0: Our next generation release that is faster, more Pythonic and Dynamic as ever Blog PyTorch 2.0: Our next generation release that is faster, more Pythonic and Dynamic as ever We are excited to announce the release of PyTorch® 2.0 which we highlighted during the PyTorch Conference on 12/2/22!…PyTorch FoundationMarch 15, 2023
New Library Updates in PyTorch 2.0 Blog New Library Updates in PyTorch 2.0 Summary We are bringing a number of improvements to the current PyTorch libraries, alongside the PyTorch…PyTorch FoundationMarch 15, 2023
Axon offers technology boost for public safety with in-car Automated License Plate Recognition on Azure Case Studies Axon offers technology boost for public safety with in-car Automated License Plate Recognition on Azure Axon, a technology leader in public safety, developed AI technology to add cutting-edge license plate…PyTorch FoundationMarch 9, 2023
How FASHABLE achieves SoA realistic AI generated images using PyTorch and Azure Machine Learning Community How FASHABLE achieves SoA realistic AI generated images using PyTorch and Azure Machine Learning Fashable is a company born at XNFY Lab (a joint initiative with Microsoft). The company’s…Orlando Ribas FernandesFebruary 23, 2023
HippoScreen Improves AI Performance by 2.4x with oneAPI Tools Case Studies HippoScreen Improves AI Performance by 2.4x with oneAPI Tools The Taiwan-based neurotechnology startup used tools and frameworks in the Intel® oneAPI Base and AI…PyTorch FoundationFebruary 21, 2023
Democratizing AI with PyTorch Foundation and ROCm™ support for PyTorch Blog Democratizing AI with PyTorch Foundation and ROCm™ support for PyTorch Last year, Meta announced that PyTorch joined the Linux Foundation as a neutral home for growing the…AMDFebruary 14, 2023
Deprecation of CUDA 11.6 and Python 3.7 Support Blog Deprecation of CUDA 11.6 and Python 3.7 Support For the upcoming PyTorch 2.0 feature release (target March 2023), we will target CUDA 11.7…PyTorch FoundationFebruary 2, 2023
NASA and IBM to Speed AI Creation with New Foundation Models Case Studies NASA and IBM to Speed AI Creation with New Foundation Models NASA and IBM are working together to create foundation models based on NASA’s data sets…PyTorch FoundationFebruary 2, 2023
Latest Colossal-AI boasts novel automatic parallelism and offers savings up to 46x for Stable Diffusion 2 Community Latest Colossal-AI boasts novel automatic parallelism and offers savings up to 46x for Stable Diffusion 2 As a new PyTorch Ecosystem Partner, we at HPC-AI Tech look forward to working with…Yang YouJanuary 31, 2023
Search Model Serving Using PyTorch and TorchServe Case Studies Search Model Serving Using PyTorch and TorchServe Walmart Search has embarked on the journey of adopting Deep Learning in the search ecosystem…PyTorch FoundationJanuary 23, 2023