This paper is about the Pathways system that is designed to support the broader Pathways vision of creating large scale, multi-task, multi-modal models w/flexible support for both large dense models as well as a variety of sparse architectures. Stay tuned for uses of the system! https://t.co/xcywVt8OiP
— Jeff Dean (@🏡) (@JeffDean) March 30, 2022