The New Jersey Institute of Technology's
Electronic Theses & Dissertations Project

Title:	High-performance matrix multiplication on Intel and FGPA platforms
Author:	Li, Gang
View Online:	njit-etd2012-080 (xiv, 76 pages ~ 0.8 MB pdf)
Department:	Department of Electrical and Computer Engineering
Degree:	Master of Science
Program:	Computer Engineering
Document Type:	Thesis
Advisory Committee:	Ziavras, Sotirios (Committee chair) Rojas-Cessa, Roberto (Committee member) Hou, Edwin (Committee member)
Date:	2012-05
Keywords:	Matrix multiplication algorithms Vector-based hardware acceleration
Availability:	Unrestricted
Abstract:	Matrix multiplication is at the core of high-performance numerical computation. Software methods of accelerating matrix multiplication fall into two categories. One is based on calculation simplification. The other one is based on increasing the memory access efficiency. Also matrix multiplication can be accelerated using vector processors. In this investigation, various matrix multiplication algorithms and the vector-based hardware acceleration method are analyzed and compared in terms of performance and memory requirements. Results are shown for Intel and Xilinx FPGA platforms. They show that when the CPU is fast, Goto's algorithm runs faster than Strassen's algorithm because the data access speed is the bottleneck in this case. On the contrary, when the CPU is slow, Strassen's algorithm runs faster because the computation complexity becomes the key factor in this case. Also, the results show that SIMD platforms, such as Intel Xeon and SIMD extensions and an in-house developed VP (Vector co-Processor), for an FPGA, can accelerate matrix multiplication substantially. It is even shown that the VP runs faster than MKL (Intel's optimized Math Kernel Library). This is because not only can the VP take advantage of larger vector lengths but it also minimizes inherent hardware overheads.