[5] Introducing GPipe, an Open Source Library for Efficiently Training Large-scale Neural Network Models [6] Which hardware do you need to train a 176B parameters model? [7] Introducing PyTorch Fully ...