Obliviate: Efficient Unmemorization for Protecting Intellectual Property in LLMs (github.com)

From Mark Russinovich : "My latest side AI research project is out: this one, Obliviate, makes a model forget how to regurgitate verbatim text from its training data, which can help it avoid copyright infringement."

https://www.threads.net/@mrussinovich/post/DHmOIYOxk60