1 comment

[ 5.5 ms ] story [ 15.2 ms ] thread
Self-improving systems require environmental interaction for continuous adaptation. Meta introduce SPICE (Self-Play In Corpus Environments), a reinforcement learning framework where a single model acts in two roles: a Challenger that mines documents from a large corpus to generate diverse reasoning tasks, and a Reasoner that solves them.