Abstract:
This paper describes WOW, a distributed system that combines virtual machine, overlay networking and peer-to-peer techniques to create scalable wide-area networks of virt...Show MoreMetadata
Abstract:
This paper describes WOW, a distributed system that combines virtual machine, overlay networking and peer-to-peer techniques to create scalable wide-area networks of virtual workstations for high-throughput computing. The system is architected to: facilitate the addition of nodes to a pool of resources through the use of system virtual machines (VMs) and self-organizing virtual network links; to maintain IP connectivity even if VMs migrate across network domains; and to present to end-users and applications an environment that is functionally identical to a local-area network or cluster of workstations. We describe a novel, extensible user-level decentralized technique to discover, establish and maintain overlay links to tunnel IP packets over different transports (including UDP and TCP) and across firewalls. We also report on several experiments conducted on a testbed WOW deployment with 118 P2P router nodes over PlanetLab and 33 VMware-based VM nodes distributed across six firewalled domains. Experiments show that the latency in joining a WOW network is of the order of seconds: in a set of 300 trials, 90% of the nodes self-configured P2P routes within 10 seconds, and more than 99% established direct connections to other nodes within 200 seconds. Experiments also show that the testbed delivers good performance for two unmodified, representative benchmarks drawn from the life-sciences domain. The testbed WOW achieves an overall throughput of 53 jobs/minute for PBS-scheduled executions of the MEME application (with average single-job sequential running time of 24.1s) and a parallel speedup of 13.5 for the PVM-based fastDNAml application. Experiments also demonstrate that the system is capable of seamlessly maintaining connectivity at the virtual IP layer for typical client/server applications (NFS, SSH, PBS) when VMs migrate across a WAN
Date of Conference: 19-23 June 2006
Date Added to IEEE Xplore: 10 July 2006
Print ISBN:1-4244-0307-3
Print ISSN: 1082-8907
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Wide Area ,
- Overlay Network ,
- Distribution System ,
- Virtual Machines ,
- Local Area Network ,
- Order Of Seconds ,
- Wide Area Network ,
- Virtual Link ,
- Access Control ,
- Administrative System ,
- Types Of Clusters ,
- Distributed Computing ,
- Types Of Connections ,
- File System ,
- Target Node ,
- Physical Network ,
- Computational Grid ,
- Current Node ,
- Private Network ,
- Connectivity States ,
- Shortcut Connection ,
- P2P Network ,
- Parallel Applications ,
- Network Interface ,
- File Transfer ,
- Execution Environment ,
- Race Conditions
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Wide Area ,
- Overlay Network ,
- Distribution System ,
- Virtual Machines ,
- Local Area Network ,
- Order Of Seconds ,
- Wide Area Network ,
- Virtual Link ,
- Access Control ,
- Administrative System ,
- Types Of Clusters ,
- Distributed Computing ,
- Types Of Connections ,
- File System ,
- Target Node ,
- Physical Network ,
- Computational Grid ,
- Current Node ,
- Private Network ,
- Connectivity States ,
- Shortcut Connection ,
- P2P Network ,
- Parallel Applications ,
- Network Interface ,
- File Transfer ,
- Execution Environment ,
- Race Conditions