Many of our builds are producing a large number of files that are needed for deployments, but managing these as artifacts between build steps is an unwieldy process.
Our solution at this point has been to include steps in custom scripts to tar our artifacts and upload the tar file as the step’s artifact. Later steps are then downloading that tar file and extracting it before continuing operations.
Alongside the existing options for
artifact_paths enable an additional option to zip or tar the globbed files before uploading them.
If the features for downloading artifacts are incorporated into core commands as well then a parallel flag to extract those files would be helpful as well.