Entry Date:
May 14, 2019

Network-Attached-Memory (NAM)


The Network-Attached-Memory (NAM) was created because of our experience with Tupleware on modern enterprise clusters. We found, that the next generation of high-performance RDMA-capable networks requires a fundamental rethinking of not only analytical frameworks but also more traditional distributed database management systems (DDBMSs). DDBMSs are commonly designed under the assumption that the network is the bottleneck and thus must be avoided as much as possible. This assumption no longer holds. With InfiniBand FDR 4x, the bandwidth available to transfer data across the network is in the same ballpark as the bandwidth of one memory channel, and the bandwidth increases even more with the most recent EDR standard. Moreover, with increasing advances in RDMA, transfer latencies improve at a similar pace. Through a theoretical analysis and experimental evaluation, we found that the "old" distributed database design is not capable of taking full advantage of fast networks and we therefore suggested a new design based on a new abstraction called Network-Attached-Memory (NAM). More surprisingly, we found that the common wisdom that distributed transactions do not scale does also no longer hold true with the next generation of networks and an according redesign of the system. Our initial results show that we can achieve a stunning 2 million distributed transactions per second over eight dual-socket e5v2 machines and Infiniband FDR 4x, versus 32,000 transactions per second using the more traditional approach.