# App for detecting flaky tests

**URL:** https://forum.buildkite.community/t/app-for-detecting-flaky-tests/1238
**Category:** General
**Created:** [September 14, 2020, 12:46pm UTC](https://forum.buildkite.community/t/app-for-detecting-flaky-tests/1238 "2020-09-14T12:46:02Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![arturop](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.buildkite.community/arturop/32/638_2.png) [@arturop](https://forum.buildkite.community/u/arturop)
#### Post date: [September 14, 2020, 12:46pm UTC](https://forum.buildkite.community/t/app-for-detecting-flaky-tests/1238/1 "2020-09-14T12:46:02Z")

</div>

Hi,

We were struggling with flaky tests, so I built an app to help us prioritize the top offenders, and to eventually fix them all.

The app automatically detects and tracks flaky tests in Buildkite pipelines using the Buildkite API, and I think this system would also be useful for other people.

This is a screenshot of the report it generates:

 ![demo](https://us1.discourse-cdn.com/flex016/uploads/buildkite1/original/1X/65f054cdb4955e349afd775cfc21165b781863ee.png)

Send me a private message on this forum if you think this will be useful for you or your company.

Thank you

---

<div class="post-metadata">

### Author: ![vitalii](https://avatars.discourse-cdn.com/v4/letter/v/d6d6ee/32.png) [@vitalii](https://forum.buildkite.community/u/vitalii)
#### Post date: [September 14, 2020, 1:07pm UTC](https://forum.buildkite.community/t/app-for-detecting-flaky-tests/1238/2 "2020-09-14T13:07:01Z")

</div>

Any plans to open-source it?

---

<div class="post-metadata">

### Author: ![arturop](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.buildkite.community/arturop/32/638_2.png) [@arturop](https://forum.buildkite.community/u/arturop)
#### Post date: [September 14, 2020, 1:31pm UTC](https://forum.buildkite.community/t/app-for-detecting-flaky-tests/1238/3 "2020-09-14T13:31:27Z")

</div>

Yes, I’ll consider it if other people find it useful. I’ll have to clean it up as it has custom logic that works just for us.  
I could also host it and let people use it

---

<div class="post-metadata">

### Author: ![Jason](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.buildkite.community/jason/32/742_2.png) [@Jason](https://forum.buildkite.community/u/Jason)
#### Post date: [September 14, 2020, 9:08pm UTC](https://forum.buildkite.community/t/app-for-detecting-flaky-tests/1238/4 "2020-09-14T21:08:44Z")

</div>

This looks really cool, thanks for posting it here @arturop 🎉

I think @vitalii suggestion is great! You should totally open source it, I think users would find it really useful!

---

<div class="post-metadata">

### Author: ![Adinata](https://avatars.discourse-cdn.com/v4/letter/a/9de053/32.png) [@Adinata](https://forum.buildkite.community/u/Adinata)
#### Post date: [September 15, 2020, 10:20pm UTC](https://forum.buildkite.community/t/app-for-detecting-flaky-tests/1238/5 "2020-09-15T22:20:03Z")

</div>

I think this will be very useful!

---

<div class="post-metadata">

### Author: ![jruhland](https://avatars.discourse-cdn.com/v4/letter/j/8491ac/32.png) [@jruhland](https://forum.buildkite.community/u/jruhland)
#### Post date: [September 16, 2020, 12:08am UTC](https://forum.buildkite.community/t/app-for-detecting-flaky-tests/1238/6 "2020-09-16T00:08:06Z")

</div>

This would be really useful for us and we’re looking into building something (Cant find how to send a DM). We would be happy to help out on the project if that would prove useful.

---

<div class="post-metadata">

### Author: ![arturop](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.buildkite.community/arturop/32/638_2.png) [@arturop](https://forum.buildkite.community/u/arturop)
#### Post date: [September 29, 2020, 12:18am UTC](https://forum.buildkite.community/t/app-for-detecting-flaky-tests/1238/7 "2020-09-29T00:18:54Z")

</div>

Hi,

Sorry for the delay. I just opened source it here: [https://github.com/arturopie/flaky-tracker](https://github.com/arturopie/flaky-tracker).  
It still needs more documentation and some clean up, but it works 😃
