Blog

This post is the second part of a multi-series blog focused on how to accelerate…

We are excited to see the release of PyTorch 2.1. In this blog, we discuss…

This post is the first part of a multi-series blog focused on how to accelerate…

In this blog, we discuss how to improve the inference latencies of the Llama 2…

In a landscape where AI innovation is accelerating at an unprecedented pace, Meta’s Llama family of open…

Supported in PyTorch 2.0 as a beta feature, oneDNN Graph leverages aggressive fusion patterns to…

Researchers and developers working with Machine Learning (ML) models and algorithms using PyTorch can now…

Quansight engineers have implemented support for tracing through NumPy code via torch.compile in PyTorch 2.1. This feature…

Motivation Large language models (LLM) such as ChatGPT or Llama have received unprecedented attention lately.…

Audio-Visual Speech Recognition (AV-ASR, or AVSR) is the task of transcribing text from audio and…

We are excited to announce the release of PyTorch® 2.1 (release note)! PyTorch 2.1 offers…

Summary We are bringing a number of improvements to the current PyTorch libraries, alongside the…

Recently, Llama 2 was released and has attracted a lot of interest from the machine learning community. Amazon…

The focus on interactive chat-generation (or conversational response-generation) models has greatly increased in the past…

Use 3D to visualize matrix multiplication expressions, attention heads with real weights, and more. Matrix…

Story at a Glance Although the PyTorch* Inductor C++/OpenMP* backend has enabled users to take…

In this blog, we share how we enabled the collection and analysis of PyTorch Profiler…