TeamCity has really good test result support. It would be nice if buildkite could offer similar, as we’ll likely need a separate tool to track our test results and history.
The features I would like is:
A list of individual test results. Support for potential grouping - we use BDD, so feature/scenario/scenario with examples grouping support would be good. We want to see a visualization at a high level of what’s working and what’s not.
Also a history over time per test, and potentially grouping histories. Being able to tell if a feature is breaking often, or if there’s a race condition in the test itself that only occurs in 10% of runs is really handy to keeping the test suite from rotting.
Do any of these tools support just XUnit input? We built a small buildkite plugin that runs as a post-command hook which simply expected a XUnit XML file on disk and uploads it to a given location for further processing.
We ended up building our own reporting frontend because we had very simple needs and no existing one - but I bet TeamCity has some feature that accepts XUnit as input and will just render that for you (via some API).
Hey @Akash-Dhanwani and @samuelkdavis_mcf, good to hear that there’s continued interest in some sort of test level reporting. Thanks for this feedback as this will inform our upcoming product priorities
