Hello, I’d like to request on failing to upload artifact be soft-fail. Currently, we define our artifacts using globs in a directory (i.e. log/test_*.log) using artifact_paths: option in pipeline YAML.
Our job is a test suite which writes to different files per test (e.g. log/test_foo.log, log/test_bar.log). The files are deleted if test passes but left on filesystem on failure. We are noticing that occasionally, on success, Buildkite agent thinks there a file exists when it doesn’t, proceeds to fail on upload, then failed the whole job (despite the tests passing!). Ideally, I want this to be soft-fail to not affect signal on our build success / failure.
Here is a screenshot of the logs on artifact upload:
I suppose an alternative way to say this: it sounds like a bug where the glob expansion happened before the job finished, because the actual job command deletes the file before terminating.
First of all welcome to Buildkite community and thank you for reaching out to us with you questions.
Yes, it would be interesting to check why in first place agent thinks there is a file existing and then fails when it tries to upload so we would like to check further on this.
Please can you send the information of the pipeline url with the details to support@buildkite.com so we can check further on this to see what is happening here. Thank you
