nvFSDP

nvFSDP - NVIDIA fork of Fully Sharded Data Parallelism that is cross-compatible with Megatron / TransformerEngine and native PyTorch.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install nvfsdp

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.0.0rc0 pre-release 2025-07-08

Issues with this package?

Page last updated 2025-07-17 17:55:03 UTC