HN Explorer

3 comments

[ 3.2 ms ] story [ 32.3 ms ] thread
Govindae
Am I understanding this correctly? The layers do not combine their inputs. Equation (2)

x_l = H_l([x_0, x_1, . . . , x_l−1])

Could be re-written: x_l = [H_l(x_0), H_l(x_1), . . . , H_l(x_l−1)]

jordancampbell
No, inputs to each layer are concatenated before being passed through H.
GChevalier
Seems promising and easy to use in practice.