Presenter: Marco CaniniTuesday, April 26th, 2022 14:00Location: Sala Ciminiera, 5th floor Corso Castelfidardo 34 ABSTRACT Scaling deep learning to a large cluster of workers is challenging due to high communication overheads that data-parallelism entails. This talk describes our efforts to rein in distributed deep learning’s communication bottlenecks. We describe SwitchML, […]
Daily Archives: April 9, 2022
1 post