Hello! I am revisiting this topic because my team needs the ability to ignore a failing step in their build. The soft_fail feature works in buildkite exactly how I would like it to; however, the reporting of the results does not translate to the GitHub checks UI to report the failure as we would like. The check says “soft fail” but shows as passing the check.
I have posted about this previously here Soft fail status in github checks but would appreciate another perspective on the desired behavior for the step-level checks status shown in GitHub for soft failures. My dev team would like to see the failure in GitHub because otherwise they do not go out to the Buildkite UI. Specifically, they want the step-level check in GitHub to fail.