Bilkent University
Department of Computer Engineering

---

M.S.THESIS PRESENTATION

 

REDUCING COMMUNICATION VOLUME INCREASE IN LATENCY EFFICIENT STORE-AND-FORWARD SCHEME

 

Salih Deniz Uzel
Master Student
(Supervisor: Prof.Dr.Cevdet Aykanat)

Computer Engineering Department
Bilkent University

Abstract: Sparse matrix operations such as Sparse matrix-vector (SpMV) are latency bound applications where number of messages sent by processors dominate the overall communication overhead. In prior work, Store and Forward (STFW) schemes were proposed and implemented to scale such fine-grain operations as SpMV by operating on specialized Virtual Process Topologies (VPTs). However, the STFW schemes incur an increase in the communication volume due to the STFW overhead. This increase in total communication volume disturbs the scalability of the STFW scheme, especially in Sparse matrix-matrix (SpMM) kernels where a sparse matrix is post-multiplied by a tall-and-skinny dense matrix. In this work, we proposed and implement a KL-based heuristic to improve the one-to-one mapping produced by the initial task partition. The objective of this heuristic is to reduce the increase in the total communication volume to be incurred by the STFW scheme in SpMV, and SpMM type of kernels. We evaluated the effectiveness of the proposed KL-based heuristic in improving the Total Communication Volume and Maximum Weighted Communication Volume metrics through experimental performance comparisons using VPTs of various dimensions and constructive mapping methods.

 

DATE: September 16, Tuesday @ 16:45 Place: EA 409