5 ms·
Why doesn't Equation 1b use the h' defined in Equation 1a?
by thecolorgreen 3y ago
Why doesn't Equation 1b use the h' defined in Equation 1a?
- atlacatl_sv 3y agoI believe h' is for the next state. y(t) is to predict the next word so it uses the current hidden state h(t).
- deleted 3y ago[deleted]
- koayon 3y agoHey! OP here Great question - h' in Equation 1a refers to the derivative of h with respect to time (t). This is a differential equation which we can solve mathematically when we have x in order to get a closed-form solution for h. We would then plug in that h (the hidden state) into equation 1b. In our case, we don't actually wait for a closed-form solution but instead compute the discrete representation (Equation 2) Hope that helps!