Tag: hyperparameter-transfer

All the articles with the tag "hyperparameter-transfer".

• The Forgiveness That Dies First

  Published:Aug 23, 2026 |  at 01:42 PM

  muP makes learning-rate transfer work by keeping the set of good rates wide. I measured what low precision does to that forgiveness, and the surprising part: the transfer survives. The forgiveness is what dies first.