My first reaction was: This has been done for decades with FPGA’s for Digital Signal Processing. In fact, Polyphase Finite Impulse Response filters are mathematically similar to some of the computations in backpropagation in NN’s. Floating point is both resource and power intensive.

What am I missing? What are they doing that has not been common practice in DSP for decades?