feat(integ-runner): detect bootstrap errors and retry tests in valid regions#1115
Draft
mrgrain wants to merge 2 commits into
Draft
feat(integ-runner): detect bootstrap errors and retry tests in valid regions#1115mrgrain wants to merge 2 commits into
mrgrain wants to merge 2 commits into
Conversation
mrgrain
had a problem deploying
to
integ-approval
February 3, 2026 20:21 — with
GitHub Actions
Failure
aws-cdk-automation
enabled auto-merge
February 3, 2026 20:21
mrgrain
marked this pull request as draft
February 3, 2026 20:21
auto-merge was automatically disabled
February 3, 2026 20:21
Pull request was converted to draft
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1115 +/- ##
==========================================
+ Coverage 87.71% 87.73% +0.01%
==========================================
Files 72 72
Lines 10116 10116
Branches 1336 1337 +1
==========================================
+ Hits 8873 8875 +2
+ Misses 1217 1215 -2
Partials 26 26
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
mrgrain
force-pushed
the
mrgrain/feat/integ-runner/bootstrap-error-detection
branch
from
February 4, 2026 17:22
2fc445c to
654eedf
Compare
mrgrain
had a problem deploying
to
integ-approval
February 4, 2026 17:22 — with
GitHub Actions
Failure
mrgrain
had a problem deploying
to
integ-approval
February 4, 2026 17:52 — with
GitHub Actions
Failure
mrgrain
force-pushed
the
mrgrain/feat/integ-runner/bootstrap-error-detection
branch
from
February 4, 2026 18:03
dc5888c to
262f3ec
Compare
mrgrain
had a problem deploying
to
integ-approval
February 4, 2026 18:03 — with
GitHub Actions
Failure
mrgrain
force-pushed
the
mrgrain/feat/integ-runner/bootstrap-error-detection
branch
from
February 5, 2026 09:27
262f3ec to
908be3b
Compare
mrgrain
had a problem deploying
to
integ-approval
February 5, 2026 09:27 — with
GitHub Actions
Failure
mrgrain
force-pushed
the
mrgrain/feat/integ-runner/bootstrap-error-detection
branch
from
February 5, 2026 11:01
908be3b to
59a5b85
Compare
mrgrain
had a problem deploying
to
integ-approval
February 5, 2026 11:01 — with
GitHub Actions
Failure
mrgrain
force-pushed
the
mrgrain/feat/integ-runner/bootstrap-error-detection
branch
from
February 5, 2026 11:40
59a5b85 to
86fc297
Compare
mrgrain
temporarily deployed
to
integ-approval
February 5, 2026 11:40 — with
GitHub Actions
Inactive
…regions Add automatic detection of bootstrap-related failures during integration test runs. When a region is not bootstrapped, the integ-runner now: - Detects bootstrap errors using a strongly-typed BootstrapError class - Removes the non-bootstrapped region from the environment pool - Re-queues failed tests to run in remaining valid regions - Provides clear feedback with the exact `cdk bootstrap` command needed This prevents wasted CI time from repeatedly scheduling tests in non-bootstrapped regions and gives users actionable error messages.
mrgrain
force-pushed
the
mrgrain/feat/integ-runner/bootstrap-error-detection
branch
from
February 19, 2026 16:00
86fc297 to
4302137
Compare
mrgrain
had a problem deploying
to
integ-approval
February 19, 2026 16:01 — with
GitHub Actions
Failure
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
When running integration tests with
--parallel-regions, tests fail with unhelpful errors if a region is not bootstrapped. The integ-runner continues scheduling tests for that region, wasting CI time and creating noise in the output.This PR introduces automatic detection and handling of bootstrap errors:
toolkit-lib changes:
BootstrapErrorclass that captures account and region information when bootstrap-related failures occurBootstrapErrorinstead of genericToolkitErrorinteg-runner changes:
BootstrapErrorduring test execution using the newdetectBootstrapError()functionEnvironmentPoolthat tracks available vs removed environmentscdk bootstrapcommand neededThis improves the developer experience by providing actionable feedback and avoiding repeated failures in non-bootstrapped regions.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license