LazyPIM: Efficient Support for Cache Coherence in Processing-in-Memory Architectures

  • Authors:
    Amirali Boroumand (Carnegie Mellon Univ.), Saugata Ghose (Carnegie Mellon Univ.), Minesh H. Patel (ETHZ), Hasan Hassan (ETHZ), Brandon Lucia (Carnegie Mellon Univ.), Nastaran Hajinazar (Simon Fraser Univ.), Kevin Hsieh (Carnegie Mellon Univ.), Krishna Malladi (Samsung Semiconductor), Hongzhong Zheng (Samsung Semiconductor), Onur Mutlu (ETHZ)
    Publication ID:
    Publication Type:
    Received Date:
    Last Edit Date:
    2719.001 (Swiss Federal Institute of Technology in Zurich)


Processing-in-memory (PIM) architectures have seen an increase in popularity recently, as the high internal bandwidth available within 3D-stacked memory provides greater incentive to move some computation into the logic layer of the memory. To maintain program correctness, the portions of a program that are executed in memory must remain coherent with the portions of the program that continue to execute within the processor. Unfortunately, PIM architectures cannot use traditional approaches to cache coherence due to the high off-chip traffic consumed by coherence messages, which, as we illustrate in this work, can undo the benefits of PIM execution for many data-intensive applications.

We propose LazyPIM, a new hardware cache coherence mechanism designed specifically for PIM. Prior approaches for coherence in PIM are ill-suited to applications that share a large amount of data between the processor and the PIM logic. LazyPIM uses a combination of speculative cache coherence and compressed coherence signatures to greatly reduce the
overhead of keeping PIM coherent with the processor, even when a large amount of sharing exists.We find that LazyPIM
improves average performance across a range of data-intensive PIM applications by 19.6%, reduces off-chip traffic by 30.9%, and reduces energy consumption by 18.0%, over the best prior approaches to PIM coherence.

4819 Emperor Blvd, Suite 300 Durham, NC 27703 Voice: (919) 941-9400 Fax: (919) 941-9450