Welcome to the first issue of the PyTorch Contributors newsletter! Keeping track of everything that’s happening in the PyTorch developer world is a big task; here you will find curated news including RFCs, feature roadmaps, notable PRs, editorials from developers, and more. If you have questions or suggestions for the newsletter, just reply back to this email.
PyTorch 1.8 was released on March 4th with support for functional transformations using
torch.fx, stabilized frontend APIs for scientific computing (
torch.linalg, Autograd for complex tensors) and significant improvements to distributed training. Read the full Release Notes.
PyTorch Ecosystem Day
On April 21, we’re hosting a virtual event for our ecosystem and industry communities to showcase their work and discover new opportunities to collaborate. The day will be filled with discussion on new developments, trends, challenges and best practices through posters, breakout sessions and networking. Register here.
@ezyang describes the challenges of maintaining a PyTorch-scale project, and the current open source processes (triaging and CI oncalls, RFC discussions) to help PyTorch operate effectively.
We launched https://dev-discuss.pytorch.org/ a low-traffic high-signal forum for long-form discussions about PyTorch internals.
[RFC] Dataloader v2
@VitalyFedyunin proposes redesigning the DataLoader to support lazy loading, sharding, pipelining data operations (including async) and shuffling & sampling in a more modular way. Join the discussion here.
- implementing the CSR storage format, where a 2D array is defined by shape and 1D tensors for compressed row indices, column indices, and values (PyTorch 1D tensor)
- introducing the Dimension Mapping storage format that generalizes a 2D CSR to multidimensional arrays using a bijective mapping between the storage and wrapper elements.
[RFC] Forward Mode AD
@albanD proposes an RFC to implement forward mode autodiff using Tensor-based dual numbers, where the real part represents the tensor and the dual part stores the forward gradient of the tensor. The core of the feature has landed (PR), with more formulas in WIP. Complete forward mode AD is expected to land by July 2021.