Poster: A Novel Shared Memory Framework for Distributed Deep Learning in High-Performance Computing Architecture

This paper proposes a novel virtual shared memory framework, Soft Memory Box (SMB), which directly shares the memory of remote nodes among distributed processes to improve communication performance/speed via deep learning parameter sharing.