github.devotd.

pytorch/torchtitan

The latest release of pytorch/torchtitan, v0.3.0, and a structure that configures pre-training, supervised fine-tuning, and reinforcement learning with FSDP and various parallelism combinations from a single Python codebase.

View on GitHub ↗
stars
★ 5.8K
Forks
1K
Language
Python
License
BSD-3-Clause
Latest release
v0.3.0

Posts

1