56% merge rate on 316 cold OSS PRs in a week
3 points
3 hours ago
| 1 comment
| github.com
| HN
kimjune01
3 hours ago
[-]
I've been running a public experiment on how far I can take agentic coding harnesses. When I ran out of my own stuff to work on, I looked to open source.

So far, I got the harness to create 368 PRs, 110 of which were resolved. Of those, I got a 56% merge rate.

The harness: https://github.com/kimjune01/sweep

But as soon as I realized what I was doing to maintainers, I worked all night to build the same pipe but backwards for PR review.

The defense: https://github.com/kimjune01/immune

Which means: bots on the contributor side, bots on the maintainer side. The surprise? What's left is two humans on either end. I accidentally invented a H2H protocol.

I'm happy to share what I learned.

reply