Publications of Torsten Hoefler

Torsten Hoefler:

High-Performance Distributed RMA Locks

(Presentation - presented in Wuxi, China, Sep. 2016, Seminar talk at Intl. Workshop on High-Performance Systems )

Abstract

We propose a topology-aware distributed Reader-Writer lock that accelerates irregular workloads for supercomputers and data centers. The core idea behind the lock is a modular design that is an interplay of three distributed data structures: a counter of readers/writers in the critical section, a set of queues for ordering writers waiting for the lock, and a tree that binds all the queues and synchronizes writers with readers. Each structure is associated with a parameter for favoring either readers or writers, enabling adjustable performance that can be viewed as a point in a three dimensional parameter space. We also develop a distributed topology-aware MCS lock that is a building block of the above design and improves state-of-the-art MPI implementations. Both schemes use non-blocking Remote Memory Access (RMA) techniques for highest performance and scalability. We evaluate our schemes on a Cray XC30 and illustrate that they outperform state-of-the-art MPI-3 RMA locking protocols by 81% and 73%, respectively. Finally, we use them to accelerate a distributed hashtable that represents irregular workloads such as key-value stores or graph processing.

Documents

download slides:

BibTeX

@misc{hoefler-wuxi16,
  author={Torsten Hoefler},
  title={{High-Performance Distributed RMA Locks}},
  year={2016},
  month={Sep.},
  location={Wuxi, China},
  note={Seminar talk at Intl. Workshop on High-Performance Systems},
  source={http://www.unixer.de/~htor/publications/},
}


serving: 3.15.10.104:31803	© Torsten Hoefler