Skip to content

Run publish on an 8-core runner, one job per core - #858

Merged
bschwedler merged 1 commit into
mainfrom
ci/publish-runner-8-core
Oct 22, 2026
Merged

bschwedler merged 1 commit into
mainfrom
ci/publish-runner-8-core

Conversation

@bschwedler

Copy link
Copy Markdown
Contributor

SOCI conversion in stage 1 of bakery ci publish dominates publish time, so run publish on a larger runner with one worker per core.

Stage 1 (index create + SOCI conversion) takes an estimated ~26 of 30 minutes for Workbench and runs on the merge runner with bakery's default of 4 workers. This doubles the default merge-builder to ubuntu-latest-amd64-8-core and passes --jobs "$(nproc)" so the worker pool tracks the runner size.

  • Interim, config-only step while SOCI conversion moves to the build runners.
  • Only helps if conversion is bound by CPU, disk, or network on the merge runner; compare publish durations before and after.
  • Callers that override merge-builder keep their runner and still get one worker per core.

Related:

SOCI conversion in stage 1 of `bakery ci publish` dominates publish
time (about 26 of 30 minutes for Workbench) and runs on the merge
runner with bakery's default of 4 workers. Double the default merge
runner and size the worker pool to its core count.

- This is an interim, config-only step while SOCI conversion moves to
  the build runners (#857).
- It only helps if conversion is bound by CPU, disk, or network on the
  merge runner; compare publish durations before and after.
- Callers that set `merge-builder` keep their runner and still get
  one worker per core.
@github-actions

Copy link
Copy Markdown

Test Results

2 475 tests  ±0   2 475 ✅ ±0   13m 50s ⏱️ + 6m 6s
    1 suites ±0       0 💤 ±0 
    1 files   ±0       0 ❌ ±0 

Results for commit 7958b47. ± Comparison against base commit b5fe395.

@bschwedler
bschwedler added this pull request to the merge queue Oct 22, 2026
Merged via the queue into main with commit 012b5ba Oct 22, 2026
28 checks passed
@bschwedler
bschwedler deleted the ci/publish-runner-8-core branch October 22, 2026 17:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants