Skip to content

ci: reuse backend setup and run tests on one runner - #712

Merged
frgfm merged 1 commit into
mainfrom
codex/ci-faster-backend-checks
Oct 9, 2026
Merged

frgfm merged 1 commit into
mainfrom
codex/ci-faster-backend-checks

Conversation

@frgfm

@frgfm frgfm commented Oct 8, 2026 •

Copy link
Copy Markdown
Member

Build once while PostgreSQL and S3 start, then run two isolated test groups on one runner. Each group applies migrations and database bootstrap before pytest. Upload coverage during cleanup.

Backend metric Before After Improvement
Developer wait for backend result 4m39s 3m23s 27% less
Total backend runner usage 4.65 runner-min 3.38 runner-min 27% less

One successful baseline and one final candidate run; timings cover backend job start to finish. Runner usage is unrounded; public billed minutes remain 0. Raw results and reproduction.

All 23 checks pass; the unchanged end-to-end cleanup check passed on retry. Local verification confirms identical migrated schemas, outcomes for all 681 existing cases, and combined line coverage. One workflow file, +18 net lines; application code, dependencies and tests stay unchanged.

@codecov

codecov Bot commented Oct 8, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 94.48%. Comparing base (9eb5e8a) to head (cad7e97).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #712      +/-   ##
==========================================
+ Coverage   91.30%   94.48%   +3.18%     
==========================================
  Files           3       59      +56     
  Lines         138     3246    +3108     
==========================================
+ Hits          126     3067    +2941     
- Misses         12      179     +167     
Flag Coverage Δ
backend 94.62% <ø> (?)
client 91.30% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@frgfm frgfm self-assigned this Oct 9, 2026
@frgfm frgfm changed the title ci: return backend test results sooner with two isolated jobs ci: share setup and run isolated backend tests on one runner Oct 9, 2026
@frgfm
frgfm force-pushed the codex/ci-faster-backend-checks branch 2 times, most recently from 9a7bf68 to 72b6813 Compare October 9, 2026 14:09
@frgfm frgfm changed the title ci: share setup and run isolated backend tests on one runner ci: reuse backend setup and initialize each test schema once Oct 9, 2026
@frgfm
frgfm force-pushed the codex/ci-faster-backend-checks branch from 72b6813 to 9a7bf68 Compare October 9, 2026 14:17
@frgfm frgfm changed the title ci: reuse backend setup and initialize each test schema once ci: reuse backend setup and run tests on one runner Oct 9, 2026
@frgfm
frgfm force-pushed the codex/ci-faster-backend-checks branch from 9a7bf68 to cad7e97 Compare October 9, 2026 19:13
@frgfm frgfm added type: improvement New feature or request topic: ci and removed ext: tests labels Oct 9, 2026
@frgfm
frgfm merged commit 4298bd0 into main Oct 9, 2026
23 of 24 checks passed
@frgfm
frgfm deleted the codex/ci-faster-backend-checks branch October 9, 2026 21:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

topic: ci type: improvement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant