Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
agi_is_coming
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
5 ms
·
1.
▲
by
agi_is_coming
2y ago
The distillation is done on-policy like RLHF -- the student model is generating the sequences and teacher is providing feedback in terms of logits.
2.
▲
by
agi_is_coming
8y ago
His page mentions that he's not working currently due to personal reasons, so you might not see his signature. http://www.cs.toronto.edu/~hinton