We were struggling with flaky tests, so I built an app to help us prioritize the top offenders, and to eventually fix them all.
The app automatically detects and tracks flaky tests in Buildkite pipelines using the Buildkite API, and I think this system would also be useful for other people.
Yes, I’ll consider it if other people find it useful. I’ll have to clean it up as it has custom logic that works just for us.
I could also host it and let people use it
This would be really useful for us and we’re looking into building something (Cant find how to send a DM). We would be happy to help out on the project if that would prove useful.