Publications of Torsten Hoefler

Towards scalable RDMA locking on a NIC

(Presentation - presented in Palo Alto, CA, USA, Aug. 2016)

Abstract

We discuss how low-level functionality such as locking should move into the network. We start with the design of a topology-aware distributed Reader-Writer lock that accelerates irregular workloads for supercomputers and data centers. The core idea behind the lock is a modular design that is an interplay of three distributed data structures: a counter of readers/writers in the critical section, a set of queues for ordering writers waiting for the lock, and a tree that binds all the queues and synchronizes writers with readers. Each structure is associated with a parameter for favoring either readers or writers, enabling adjustable performance that can be viewed as a point in a three dimensional parameter space. We also develop a distributed topology-aware MCS lock that is a building block of the above design and improves state-of-the-art MPI implementations. Both schemes use non-blocking Remote Memory Access (RMA) techniques for highest performance and scalability. We evaluate our schemes on a Cray XC30 and illustrate that they outperform state-of-the-art MPI-3 RMA locking protocols by 81% and 73%, respectively. Finally, we use them to accelerate a distributed hashtable that represents irregular workloads such as key-value stores or graph processing. We then describe an abstract machine model for offload-enabled architectures. The Portals 4 network interface is used to implement the proposed abstract model. We show how complex network algorithms such as collective operations can be offloaded with this machine model. We believe that other services such as locks can be offloaded as well.

Documents

download slides:

BibTeX

@misc{hoefler-locks-hp-labs,
  author={Torsten Hoefler},
  title={{Towards scalable RDMA locking on a NIC}},
  year={2016},
  month={Aug.},
  location={Palo Alto, CA, USA},
  source={http://www.unixer.de/~htor/publications/},
}


serving: 3.12.71.166:20501	© Torsten Hoefler