Tweeted By @PyTorch
PyTorch/XLA, a package that lets PyTorch connect to @GCPcloud TPUs and use TPU cores as devices, is now generally available. Highlights:
— PyTorch (@PyTorch) September 29, 2020
- Support for Intra-Layer Model Parallelism
- Additional XLA ops
- Integrations with Colab and Kaggle notebookshttps://t.co/VwgPHlqe5M