Abstract:
IPU Foundations • AI is nascent – facilitating exploration is as vital as executing known algorithms. • Tera-scale models will be necessary for “super-human” AI. • Sparse...Show MoreMetadata
Abstract:
IPU Foundations • AI is nascent – facilitating exploration is as vital as executing known algorithms. • Tera-scale models will be necessary for “super-human” AI. • Sparse evaluation will be necessary at tera-scale, \text{for} \$ and Watts. • Rich natural data is sequences, images, and graphs. • Post-Dennard, keep memory and logic close. • Post-Moore, parallel computing over many chips.
Published in: 2021 IEEE Hot Chips 33 Symposium (HCS)
Date of Conference: 22-24 August 2021
Date Added to IEEE Xplore: 20 October 2021
ISBN Information: