Self-improving systems require environmental interaction for continuous adaptation. Meta introduce SPICE (Self-Play In Corpus Environments), a reinforcement learning framework where a single model acts in two roles: a Challenger that mines documents from a large corpus to generate diverse reasoning tasks, and a Reasoner that solves them.
1 comment
[ 5.5 ms ] story [ 15.2 ms ] thread