Any sparse GEMM cu file guideline or blog suggest?

Hi! I am learning sparse GEMM…Is it possible to suggest some blogs or guidelines? Thank you!!

I have found out cusparse is not open sourced…Sad…

this may be of interest

this maybe of interest although it focuses on a ASIC implementation

armadillo is a C++ library that includes sparse matrix routines in source form, and CUSP is a CUDA library that includes sparse matrix routines in source form.

Thank you very much!!! Actually I meet a sparse case like this: (very simple)
(dense) 30720 * 3072 @ (dense with sparsity) 3072 * 64 some columns of B can be all zero. Seems we can just skip those columns!

But actually we can not change the data, the input data should still have zero columns and output should still have zero columns…Just like the method metioned here in cutlass: CUTLASS: Fast Linear Algebra in CUDA C++ | NVIDIA Technical Blog We want to coalesced read B, skip some column will be uncoalesced…I am thinking maybe we can create B transposely…And skip some lines instead. So we will read A and B in a same way. (Slow…)

(threadIdx.x / 32) * m + blockIdx.y * 128 + threadIdx.x % 32 * 4 (read global A and write to register)

Well…Any suggestions? (Haha…maybe too complicated…Anyway, thank you~)

no suggestions

The last time I tried to write an actual sparse multiplication routine (it was spmv, not spmm) was about 10 years ago, I got to within 10 percent of cusparse and decided I was wasting my time.

1 Like

Haha, you are right. Well, thank you!!!

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.