Open Models Almanac
Methods

single mention · not yet filed

Omit weight decay

The sources on this page only mention it in passing.

Also called we do not use weight decay.