Skip to content

Update APM SDK benchmarks reference - #12740

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
ci/update-apm-sdks-benchmarks-reference-20261004
Oct 7, 2026
Merged

gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
ci/update-apm-sdks-benchmarks-reference-20261004

Conversation

@dd-octo-sts

@dd-octo-sts dd-octo-sts Bot commented Oct 4, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

This PR updates the pinned apm-sdks-benchmarks GitLab CI includes and runtime clones to
DataDog/apm-sdks-benchmarks@454a97647cbc16ab7fd20e917aa31532ba7532eb.

Motivation

Keep Java SDK benchmarks current while retaining reproducible CI configuration.

Contributor Checklist

  • Verify CI passes successfully

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@dd-octo-sts
dd-octo-sts Bot requested a review from a team as a code owner October 4, 2026 05:35
@dd-octo-sts dd-octo-sts Bot added type: feature Enhancements and improvements comp: testing Testing labels Oct 4, 2026
@dd-octo-sts
dd-octo-sts Bot requested a review from a team as a code owner October 4, 2026 05:35
@dd-octo-sts dd-octo-sts Bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Oct 4, 2026
@dd-octo-sts
dd-octo-sts Bot requested review from amarziali and randomanderson and removed request for a team October 4, 2026 05:35

@datadog-datadog-prod-us1-2 datadog-datadog-prod-us1-2 Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bits Code Review: PASS

More details

The shared SHA anchor consistently updates every benchmark CI include and the runtime clone variable to the same pinned revision.

Was this helpful? React 👍 or 👎

Open Bits AI session

🤖 Bits Code Review · Commit aeb194d · @DataDog review to ask questions

@datadog-datadog-prod-us1-2

This comment has been minimized.

@dd-octo-sts

dd-octo-sts Bot commented Oct 4, 2026

Copy link
Copy Markdown
Contributor Author

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 13.95 s 13.95 s [-0.8%; +0.8%] (no difference)
startup:insecure-bank:tracing:Agent 12.98 s 13.03 s [-1.2%; +0.4%] (no difference)
startup:petclinic:appsec:Agent 17.28 s 17.17 s [-0.3%; +1.6%] (no difference)
startup:petclinic:iast:Agent 16.41 s 17.17 s [-8.7%; -0.2%] (maybe better)
startup:petclinic:profiling:Agent 16.60 s 16.94 s [-3.3%; -0.7%] (maybe better)
startup:petclinic:sca:Agent 17.19 s 17.09 s [-0.2%; +1.4%] (no difference)
startup:petclinic:tracing:Agent 16.21 s 16.28 s [-1.5%; +0.5%] (no difference)

Commit: aeb194d7 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@AlexeyKuznetsov-DD

Copy link
Copy Markdown
Contributor

/merge -f --reason "No need to run MQ, validated in PR"

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351 Bot commented Oct 7, 2026 •

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-10-07 18:15:56 UTC ℹ️ Start processing command /merge -f --reason "No need to run MQ, validated in PR"


2026-10-07 18:16:00 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 0s (p90).


2026-10-07 18:16:11 UTC ℹ️ MergeQueue: This merge request was merged

Warning

This change was merged without running any pre merge CI checks

Reason: No need to run MQ, validated in PR

@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854d Bot merged commit 155472a into master Oct 7, 2026
612 of 615 checks passed
@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854d Bot deleted the ci/update-apm-sdks-benchmarks-reference-20261004 branch October 7, 2026 18:16
@github-actions github-actions Bot added this to the 1.68.0 milestone Oct 7, 2026
zacharycmontoya pushed a commit that referenced this pull request Oct 7, 2026
chore: Update APM SDK benchmarks reference

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

Co-authored-by: alexey.kuznetsov <alexey.kuznetsov@datadoghq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes type: feature Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants