Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

"Lessons from the Real World" and "The Limits of Resilience" discussed this.


Not quite, that seems to be about quantizing and dropping out after training, not random dropout throughout training.

But apparently that isn't done much any more and has been partly superseded with things like weight decay.




Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: