I'm curious what a "stripped down version" of Github can offer in terms of functionality that Github does not? Is it not simpler to have the agents register as Github repos since the infrastructure is already in place?
I was exploring how to parallelize autoresearch workers. The idea is to have a trusted pool of workers who can verify contributions from a much larger untrusted pool. It's backed bit a naked git repo and a sqlite with a simple go server. It's a bit like block chain in that blocks = commits, proof of work = finding a lower val_bpb commit, and reward = place on the leaderboard. I wouldn't push the analogy too far. It's something I'm experimenting with but I didn't release it yet (except for briefly) because it's not sufficiently simple/canonical. The core problem is how to neatly and in a general way organize individual autoresearch threads into swarms, inspired by SETI@Home, or Folding@Home, etc.
No HTTPS in 2026. False origin that suggest a massive improvement. Leaderboard doesn't work. Instructions are "repeatedly download this code and execute it on your machine". No way to see the actual changes being made.
We can do better than this as an industry, or at least we used to be better at this. Where's the taste?
Don’t mean to pick on you specifically, but this comment feels like a pretty good distillation of a certain mindset you often see in Googlers:
* we know better
* we judge everything against internal big-company standards
* we speak as if we’re setting the bar for “the industry”
Someone is openly pushing on a frontier, sharing rough experiments, and educating a huge number of people in the process — and the response is: “we can do better than this as an industry.”
Can you? When is Google launching something like this?
I tried to copy the instruction and pasted in Note to see what it said, but I could not. Either the clipboard was empty or something prevented Note recognized it as just text.
12 comments
[ 2.2 ms ] story [ 34.0 ms ] threadhttps://github.com/karpathy/autoresearch/pull/92
https://www.ensue-network.ai/autoresearch
Anyway, "1980 experiments, 6 improvements" makes me wonder if this is better than a random search or some simple heuristic.
We can do better than this as an industry, or at least we used to be better at this. Where's the taste?
* we know better
* we judge everything against internal big-company standards
* we speak as if we’re setting the bar for “the industry”
Someone is openly pushing on a frontier, sharing rough experiments, and educating a huge number of people in the process — and the response is: “we can do better than this as an industry.”
Can you? When is Google launching something like this?