It’d be interesting to see this compared against a human baseline — e.g., a competent engineer with a fixed time budget on the same tasks.
If both sides refactor the same function into multiple smaller ones (extract method) or rename it, can Weave detect that as a structural refactor, or does it become “delete + add”? Any heuristics beyond name matching?
That’s fair - strict determinism isn’t possible in the traditional sense. I was thinking more along the lines of bounded reproducibility. If the model, parameters, system prompt, and toolchain are pinned, you might not…
I noticed in the README that each commit message includes the agent and model, which is a nice start toward reproducibility. I’m wondering how deep you plan to go on environment pinning beyond that. Is the system prompt…
It’d be interesting to see this compared against a human baseline — e.g., a competent engineer with a fixed time budget on the same tasks.
If both sides refactor the same function into multiple smaller ones (extract method) or rename it, can Weave detect that as a structural refactor, or does it become “delete + add”? Any heuristics beyond name matching?
That’s fair - strict determinism isn’t possible in the traditional sense. I was thinking more along the lines of bounded reproducibility. If the model, parameters, system prompt, and toolchain are pinned, you might not…
I noticed in the README that each commit message includes the agent and model, which is a nice start toward reproducibility. I’m wondering how deep you plan to go on environment pinning beyond that. Is the system prompt…