Skip to content

test(e2e): stage AWS pull artifacts in S3 - #18662

Draft
hakman wants to merge 1 commit into
kubernetes:masterfrom
hakman:e2e-aws-s3-staging
Draft

test(e2e): stage AWS pull artifacts in S3#18662
hakman wants to merge 1 commit into
kubernetes:masterfrom
hakman:e2e-aws-s3-staging

Conversation

@hakman

@hakman hakman commented Aug 4, 2026

Copy link
Copy Markdown
Member

The kubetest2-kops deployer stages AWS build artifacts in an ephemeral S3 bucket to exercise the s3:// KOPS_BASE_URL path from #18661. The bucket name uses the full BUILD_ID so separate kubetest2 invocations derive the same name without sharing state. The deployer creates the bucket during --build and deletes it during --down or after Build or Up fails. It never manages buckets supplied through KOPS_STAGING_BUCKET. Without BUILD_ID, staging continues to use GCS. Names over S3's 63-character limit fail instead of being truncated, avoiding collisions between jobs.

s3-publish-ci re-exports AWS_REGION because the Makefile unexports it and hack/upload needs it to resolve the AWS CLI region. Uploads use --private because the bucket policy grants public read while its public access block settings reject object ACLs.

upgrade.sh delays acquiring version B artifacts until after kubetest2 --down because teardown deletes staged artifacts. It builds a local version B binary first so cleanup can run before that acquisition.

/cc @rifelpet @ameukam

@kubernetes-prow

Copy link
Copy Markdown
Contributor

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@kubernetes-prow
kubernetes-prow Bot requested review from ameukam and rifelpet August 4, 2026 05:47
@kubernetes-prow kubernetes-prow Bot added do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files. labels Aug 4, 2026
@kubernetes-prow

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign olemarkus for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

The kubetest2-kops deployer stages AWS build artifacts in an
ephemeral S3 bucket to exercise the s3:// KOPS_BASE_URL path from
kubernetes#18661. The bucket name uses the full BUILD_ID so
separate kubetest2 invocations derive the same name without sharing
state. The deployer creates the bucket during --build and deletes it
during --down or after Build or Up fails. It never manages buckets
supplied through KOPS_STAGING_BUCKET. Without BUILD_ID, staging
continues to use GCS. Names over S3's 63-character limit fail instead
of being truncated, avoiding collisions between jobs.

s3-publish-ci re-exports AWS_REGION because the Makefile unexports it
and hack/upload needs it to resolve the AWS CLI region. Uploads use
--private because the bucket policy grants public read while its
public access block settings reject object ACLs.

upgrade.sh delays acquiring version B artifacts until after kubetest2
--down because teardown deletes staged artifacts. It builds a local
version B binary first so cleanup can run before that acquisition.
@hakman
hakman force-pushed the e2e-aws-s3-staging branch from a902e4d to d1b19e5 Compare August 4, 2026 06:00
@kubernetes-prow kubernetes-prow Bot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Aug 8, 2026
@kubernetes-prow

Copy link
Copy Markdown
Contributor

PR needs rebase.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant