Skip to content

Throttle large parallel fan-out with throttle categoy#257

Open
saheerb wants to merge 1 commit into
Mbed-TLS:mainfrom
saheerb:main
Open

Throttle large parallel fan-out with throttle categoy#257
saheerb wants to merge 1 commit into
Mbed-TLS:mainfrom
saheerb:main

Conversation

@saheerb

@saheerb saheerb commented Jun 20, 2026

Copy link
Copy Markdown
Contributor

Wrap the main tls-testing parallel fan-out in the
mbetls-parallel-limit throttle category.

This was the recommended approach by cloudbees to reduce queue pressure.

@gilles-peskine-arm gilles-peskine-arm left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM on code reading. But I'm not a Jenkins or Groovy experts.

Have you run a test build? I'd like to see a passing build, and a build where some jobs fail.

@saheerb saheerb force-pushed the main branch 2 times, most recently from b0cfa65 to 04e6a79 Compare June 21, 2026 00:39
@saheerb saheerb changed the title Run tls-testing in serial batches when TLS_TEST_BATCH_SIZE is set Throttle large parallel fan-out with throttle categoy Jun 21, 2026
@saheerb

saheerb commented Jun 21, 2026

Copy link
Copy Markdown
Contributor Author

LGTM on code reading. But I'm not a Jenkins or Groovy experts.

Have you run a test build? I'd like to see a passing build, and a build where some jobs fail.

I changed the approach after recommendation from cloudbees. Test run:

https://ci.test.trustedfirmware.org/view/Mbed-TLS/job/mbed-tls-framework-multibranch/job/PR-309-head/8/cloudbees-pipeline-explorer/

Comment thread vars/mbedtls.groovy Outdated

@gilles-peskine-arm gilles-peskine-arm left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure how it helps, but ok on code reading. Approved pending validation through a CI run.

Can you please run a test job on the normal CI instance (not the test instance, which might be configured differently), e.g. the PR job on https://github.com/Mbed-TLS/mbedtls-restricted/pull/906 ?

@saheerb

saheerb commented Jun 22, 2026

Copy link
Copy Markdown
Contributor Author

Not sure how it helps, but ok on code reading. Approved pending validation through a CI run.

Can you please run a test job on the normal CI instance (not the test instance, which might be configured differently), e.g. the PR job on https://github.com/Mbed-TLS/mbedtls-restricted/pull/906 ?

I dont think I can test this change in PROD without merging it in. At least not without editing job/pipeline lib config. What I suggest is to bring this in and if it doesn't work we can alway revert.

Wrap the main tls-testing parallel fan-out in the
mbetls-parallel-limit throttle category.

This applies to both PR and release job paths and is intended to reduce
queue pressure from very large numbers of EC2-backed node() branches
entering the queue at once.

This is a workaround to limit controller-side scheduling contention
until the underlying CloudBees/Jenkins issue is better understood.

Signed-off-by: Saheer Babu <saheer.babu@arm.com>
@ronald-cron-arm

Copy link
Copy Markdown
Contributor

Currently the CI is working as expected and we have a fair amount of PR under test. I would not merge that change right now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Development

Successfully merging this pull request may close these issues.

3 participants