LLaMA Pro: Progressive LLaMA with Block Expansion (arxiv.org)

Appears to be a way to address catastrophic forgetting in LLMs