What CI looks like at a 100-person team (PostHog)
22 points
4 days ago
| 3 comments
| mendral.com
| HN
simianwords
23 minutes ago
[-]
interesting that they have an agent that is triggered on flaky CI failures. but it seems far too specific -- you can have pull request on many other triggers.

there doesn't seem to be any upside on having it only for flaky tests because the workflow is really agnostic to the context.

reply
IshKebab
25 minutes ago
[-]
> Every commit to main triggers an average of 221 parallel jobs

Jesus, this is why Bazel was invented.

reply
zX41ZdbW
29 minutes ago
[-]
Two problematic statements in this article:

1. Test pass rate is 99.98% is not good - the only acceptable rate is 100%.

2. Tests should not be quarantined or disabled. Every flaky test deserves attention.

reply
lab14
17 minutes ago
[-]
a test pass rate of 100% is a fairy tale. maybe achievable on toy or dormant projects, but real world applications that make money are a bit more messy than that.
reply
rkomorn
27 minutes ago
[-]
On top of 2., new tests should be stress-tested to make sure they aren't flaky so that the odds of merging them go down.
reply