LoRA and Weight Decay (2023) (irhum.github.io)

Every time I see an article about LoRA on here I think it’s about the radio technology LoRa that powers LoRaWAN and just for a moment I’m very excited.