Skip to content

chore(agents): add dd-trace-rb overrides for dd-apm-sdk-review - #6307

Draft
robertomonteromiguel wants to merge 12 commits into
robertomonteromiguel/dd-apm-sdk-review-core-copyfrom
robertomonteromiguel/dd-apm-sdk-review-rb-overrides
Draft

robertomonteromiguel wants to merge 12 commits into
robertomonteromiguel/dd-apm-sdk-review-core-copyfrom
robertomonteromiguel/dd-apm-sdk-review-rb-overrides

Conversation

@robertomonteromiguel

@robertomonteromiguel robertomonteromiguel commented Sep 11, 2026 •

Copy link
Copy Markdown
Contributor

What does this PR do?

Adds the dd-trace-rb layer on top of the shared skill copy.

  • .agents/dd-apm-sdk-review-overrides/ — Ruby reviewer facts (conventions, security, repo context)
  • AGENTS.md — short hook: local agents run the skill; Codex reads review-without-harness.md
  • .llm-validation/ — cases that exercise those rules, plus the GitLab "llm validation" include

Stacked on the core-copy PR. Shared skill source: dd-apm-sdk-review-core#1.

Motivation

This is the half of #6301 that Ruby reviewers should actually read.

Additional Notes

How to review

  • Start here: .agents/dd-apm-sdk-review-overrides/
  • Then: the AGENTS.md Review Guidelines block
  • Then: .llm-validation/ if you care about the gate
  • Skip .agents/skills/dd-apm-sdk-review/ — that is the parent PR / core repo

Merge with the parent skill-copy PR, not as a standalone.

Change log entry

None.

Made with Cursor

Repo-specific reviewer facts, AGENTS.md hook, and llm-validation
suite. Stacked on the verbatim skill copy.
@dd-octo-sts

dd-octo-sts Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

👋 Hey @DataDog/ruby-guild, please fill "Change log entry" section in the pull request description.

If changes need to be present in CHANGELOG.md you can state it this way

**Change log entry**

Yes. A brief summary to be placed into the CHANGELOG.md

(possible answers Yes/Yep/Yeah)

Or you can opt out like that

**Change log entry**

None.

(possible answers No/Nope/None)

Visited at: 2026-09-11 09:59:02 UTC

@robertomonteromiguel

Copy link
Copy Markdown
Contributor Author

@codex review

@datadog-prod-us1-3

datadog-prod-us1-3 Bot commented Sep 11, 2026 •

Copy link
Copy Markdown

Tests

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

🎯 Code Coverage (details)
• Patch Coverage: 100.00%
• Overall Coverage: 90.36% (+0.01%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 8eb9c42 | Docs | View more details | Give us feedback!

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7f1887a7b9

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread .agents/dd-apm-sdk-review-overrides/reviewers/security.md Outdated
Comment thread .agents/dd-apm-sdk-review-overrides/reviewers/conventions.md Outdated
Keep credentials as P0; treat request-body/query/PII as Ask First.
Flag Time.now in shipped code or specs. Merge the core skill-copy sync.
Use the current platform SHA for the GitLab include and the job clone.
Bring in the master merge so the stacked overrides PR stays current.
@robertomonteromiguel

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 0c51c34019

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread .llm-validation/suites/dd-apm-sdk-review.yaml Outdated
Comment thread .llm-validation/config.yaml
@pr-commenter

pr-commenter Bot commented Sep 11, 2026 •

Copy link
Copy Markdown

LLM Validation

LLM Validation Gate — dd-apm-sdk-review

✅ PASS

  • No blocking-case regressions; the quality change is within noise (baseline/candidate confidence intervals overlap).

Analysis

Changed instruction file(s): AGENTS.md, .agents/skills/dd-apm-sdk-review/SKILL.md, .agents/skills/dd-apm-sdk-review/reviewers/_common.md, .agents/skills/dd-apm-sdk-review/reviewers/coherence.md, .agents/skills/dd-apm-sdk-review/reviewers/correctness.md, .agents/skills/dd-apm-sdk-review/reviewers/design.md, .agents/skills/dd-apm-sdk-review/reviewers/performance.md, .agents/skills/dd-apm-sdk-review/reviewers/maintainability.md, .agents/skills/dd-apm-sdk-review/reviewers/conventions.md, .agents/skills/dd-apm-sdk-review/reviewers/cross-sdk.md, .agents/skills/dd-apm-sdk-review/reviewers/report-template.md, .agents/skills/dd-apm-sdk-review/review-without-harness.md, .agents/dd-apm-sdk-review-overrides/repo-context.md, .agents/dd-apm-sdk-review-overrides/reviewers/conventions.md.

No safety or blocking-case regressions across 1 case(s). Overall pairwise win-rate 75% [51%–99%], quality +4.6 — see the verdict above for whether that clears the noise band.

Results

  • Pairwise win-rate: 75% [51%–99%] — candidate's share of blind comparisons (90% CI; spanning 50% = no clear difference)
  • Overall quality: 76.7 → 81.2 (/100, +4.6)
  • Bad signals introduced (advisory): 0
  • Candidate criteria coverage (advisory): 2/2 (100%) — expected_criteria the candidate met; does not affect the gate
  • Blocking-case regressions: 0

Per-dimension scores, token usage, latency, and estimated cost are in the CI job logs.

Keep the stacked overrides branch on the latest verbatim skill copy.
…NTS.md

Give the ENV/Time.now fixture a lib/ path and include AGENTS.md in the
case files and the monitored instruction list, matching the JS pattern.
@robertomonteromiguel

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. You're on a roll.

Reviewed commit: 9f1d4ea1bc

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Keep the stacked overrides branch on the latest verbatim skill copy.
@robertomonteromiguel

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Swish!

Reviewed commit: e186296a35

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread .agents/dd-apm-sdk-review-overrides/reviewers/conventions.md Outdated
Comment thread .agents/dd-apm-sdk-review-overrides/reviewers/conventions.md
Comment thread .agents/dd-apm-sdk-review-overrides/reviewers/security.md Outdated
Comment thread .llm-validation/README.md Outdated
@Strech

Strech commented Sep 15, 2026

Copy link
Copy Markdown
Member

@codex based on best practices described here .claude/skills/write-rbs/README.md and skill example from here .claude/skills/write-rbs/SKILL.md do a review

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 15, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-09-15T12:28:11.813238Z e186296 Manual request
🔒 Security Review ✅ Completed 2026-09-15T12:27:15.835126Z e186296 Manual request
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector

Copy link
Copy Markdown

🛡️ Codex Security Review · Automatically triggered

Security review completed. No security issues were found in this pull request.

Reviewed commit: e186296a35

View security finding report

Only the user who started this review can view the report in Codex.

ℹ️ About Codex security reviews in GitHub

This is an experimental Codex feature. Security reviews are triggered when:

  • You comment "@codex security review"
  • A regular code review gets triggered (for example, "@codex review" or when a PR is opened), and you’re opted in so security review runs alongside code review

Once complete, Codex will leave suggestions, or a comment if no findings are found.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e186296a35

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread .agents/dd-apm-sdk-review-overrides/repo-context.md
Codex security covers that lane. Local skill runs on demand; GitHub Codex follows review-without-harness.md.
Drop the redundant ENV addendum (EnvUsageCop already owns lib/), keep Time.now on lib/**/*.rb, and exclude .agents/.llm-validation from the packaged gem.
@robertomonteromiguel

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 4dbc2b0dae

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread .agents/dd-apm-sdk-review-overrides/repo-context.md
Comment thread .agents/dd-apm-sdk-review-overrides/reviewers/conventions.md Outdated
Comment thread .agents/skills/dd-apm-sdk-review/SKILL.md Outdated
Comment thread .agents/skills/dd-apm-sdk-review/reviewers/security.md Outdated
@robertomonteromiguel

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Breezy!

Reviewed commit: a503bb36b1

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Take the verbatim skill from the copy so the stacked PR no longer
conflicts on SKILL.md / reviewers.
@robertomonteromiguel

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Keep them coming!

Reviewed commit: be4208f796

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread .agents/dd-apm-sdk-review-overrides/reviewers/conventions.md Outdated
RFC-style emphasis so the conventions reviewer treats the ENV/Time.now
carve-out as a hard MUST NOT, not casual English.

Co-authored-by: Cursor <cursoragent@cursor.com>
dd-apm-ecosystems Bot added a commit that referenced this pull request Sep 16, 2026
Recurring code-review theme observed across multiple independent
PRs in the last 60 days (e.g. #6278 "Always use
Datadog::Core::Utils::Time.now", plus review comments on #6307
codifying the convention): direct `Time.now` calls in library code
should be replaced with `Datadog::Core::Utils::Time.now`, which
captures the original (non-monkey-patched) implementation once at
load time so it is not affected by test tools like Timecop and is
safe to call from any thread.

Mirrors the structure of the existing CustomCops::EnvUsageCop.
@robertomonteromiguel
robertomonteromiguel marked this pull request as draft September 18, 2026 15:10

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants