> you have to build hardware that matches the dimensions of the algorithm Yes the benefits are realized in custom hardware designs as opposed to software, howe

> you have to build hardware that matches the dimensions of the algorithm Yes the benefits are realized in custom hardware designs as opposed to software, however, the hardware architectures work for multiplying matrices of arbitrary dimensions by splitting up larger matrices into smaller tiles, then summing up the tile products to form the final larger matrix products (i.e. GEMM)