Autoresearch, Claude and Constrained Optimization (elliotcsmith.com)

reading that tweet it came across to me that he set the agent up for failure. garbage in, garbage out! maybe a more fair comparison would have been a prompt to design & implement the renderer with a clean start. throwing it all out and starting from scratch is something these models, and people, are explicitly trained against doing

other than that, I don't think any serious person would trust a ralph-loop to accomplish something truly substantial. it's good for ensuring rote tasks get completed without the agent stopping too soon, but not much more

I did use default settings on those tools. I'd agree it wasn't the best benchmark and certainly wouldn't hold up if the goal here was to break any records in compression. The tools and settings chosen were mostly to validate 'this ended up roughly in the same ballpark as other tools' over 'Claude burned a lot of tokens and still made a terrible compression tool'.