Row-wise Accumulator ImplementationΒΆ
This page provides the Row-wise accumulator implementation details. The following figure shows the row-wise accumulator logic:
- There are three input streams, namely the columnvector value stream, the NNZ value stream and the NNZ row indices stream.
- Each stream contains multiple entries being processed in parallel. For example, the
4
entries shown in the figure. - The number of parallel entries can be configured at the compile time by
SPARSE_parEntries
. - The
xBarRow
logic carries out the multiplication of the column value and the NNZ value, and distributes the results and their corresponding row indices to the accumulator logic implemented by therowInterleave
androwAcc
modules. - The
`rowInterleave
module is designed to address the long latency of floating point accumulation by overprovising the accumulators. - Each
rowInterleave
module will drive severalrowAcc
modules for row-wise accumulation. The number ofrowInterleave
modules is configured at compile time bySPARSE_parEntries
. - The number of
rowAcc
modules driven by eachrowInterleave
module is configured bySPARSE_parGroups
at the compile time. - There is a on-chip memory block in each
rowAcc
module to store the accumulation results. - Once the accumulation operation is finished, each
rowAcc
module will read out the data in the on-chip memory and send them torowAgg
module to be merged together and written to the device memory, for example, HBM.