Issues

• minimatch and glob advisories are fixed only on new majors no parent declares

  dependabot-scoutdependenciesjavascriptneeds-discussionP3 - low
  langwatch/scenario#1041 · Filter by author langwatch-agent opened on Nov 2, 2026

• Run keeps going when the agent returns empty replies; user simulator takes the agent's role

  langwatch/scenario#1033 · Filter by author drewdrewthis opened on Oct 26, 2026
  1

• zod 3 has no fix for the oversized-collection advisory (GHSA-mrhx-c7xc-m3w5): decide on zod 4

  dependabot-scoutdependenciesjavascriptneeds-discussionP2 - mediumrefactor
  langwatch/scenario#1032 · Filter by author langwatch-agent opened on Oct 26, 2026

• Python script steps treat an explicit empty string as automatic generation

  langwatch/scenario#1030 · Filter by author March-7 opened on Oct 23, 2026

• Pillow advisories below 13.0.0 stay open while Python 3.10 is supported

  dependabot-scoutdependenciesneeds-discussionP2 - mediumpython:uv
  langwatch/scenario#1029 · Filter by author langwatch-agent opened on Oct 23, 2026
  1

• Proposal: opt-in CIGE test-case example/adapter for Scenario (Context, Intent, Guardrails, Execution)

  langwatch/scenario#1027 · Filter by author vivekkrishna opened on Oct 15, 2026

• JudgeAgent errors on local Ollama models: forced tool_choice is accepted but not enforced, so no tool call comes back

  langwatch/scenario#1026 · Filter by author mouadhassal opened on Oct 14, 2026

• Idea: simulator fidelity checks (language, brief coverage, role). Measured drift across 6 languages

  langwatch/scenario#1025 · Filter by author mouadhassal opened on Oct 14, 2026
  1

• RedTeamAgent fails with a Gemini attacker model (empty metaprompt plan, ends on a model turn)

  bugP2 - mediumpython:uv
  langwatch/scenario#1019 · Filter by author drewdrewthis opened on Oct 13, 2026
  

• Go SDK: review notes from vendoring the parity release candidate

  langwatch/scenario#1017 · Filter by author 0xdeafcafe opened on Oct 12, 2026

• javascript-ci: evaluators-on-scenarios example fails on every run, and the examples gate hides why

  bugdependabot-scoutfailing-cijavascriptP1 - high
  langwatch/scenario#1010 · Filter by author langwatch-agent opened on Oct 1, 2026

• voice: option for the agent under test to speak first on connect (greeting-led calls)

  langwatch/scenario#995 · Filter by author drewdrewthis opened on Sep 14, 2026

• voice: callee (agent under test) audio messages carry no transcript in the run message stream

  langwatch/scenario#994 · Filter by author drewdrewthis opened on Sep 14, 2026

• voice: voice.adapter.disconnect span lands on a detached trace id, not the scenario's trace

  langwatch/scenario#993 · Filter by author drewdrewthis opened on Sep 13, 2026

• voice/twilio a-leg: callee greets before the simulator's first line; greeting is consumed as the callee's turn-1 reply

  langwatch/scenario#992 · Filter by author drewdrewthis opened on Sep 13, 2026
  1

• voice: Python Twilio adapter needs the same inbound speech gate as JS (#990)

  langwatch/scenario#991 · Filter by author drewdrewthis opened on Sep 13, 2026

• voice: TypeScript/Python parity matrix and gaps (adapters, telemetry, testing surface)

  enhancementjavascript
  langwatch/scenario#986 · Filter by author drewdrewthis opened on Sep 9, 2026

• python: pytest.ini sets a global 60s timeout that pyproject.toml says does not exist

  bug
  langwatch/scenario#985 · Filter by author drewdrewthis opened on Sep 9, 2026

• voice/twilio: a-leg place_call should fail fast on busy / no-answer / failed instead of waiting the full stream-connect timeout

  enhancement
  langwatch/scenario#984 · Filter by author drewdrewthis opened on Sep 9, 2026

• voice/twilio: inbound webhook returns HTTP 403 to real Twilio requests through the trycloudflare tunnel (Twilio 11200 → call busy)

  bug
  langwatch/scenario#983 · Filter by author drewdrewthis opened on Sep 9, 2026

• Judge ends the run at the first turn when a criterion has not been reached yet

  langwatch/scenario#980 · Filter by author rogeriochaves opened on Sep 7, 2026

• Idea: coverage-bin tracking layer for scenario test runs

  langwatch/scenario#970 · Filter by author Lurpan opened on Sep 5, 2026

• OrcaRouter provider support for Scenario

  langwatch/scenario#965 · Filter by author dulcestentaciones2920-debug opened on Sep 4, 2026

• Print the judge verdict and unmet criteria on scenario failure

  langwatch/scenario#963 · Filter by author rogeriochaves opened on Sep 1, 2026
  1

• fix(js): retry one empty user simulator completion

  langwatch/scenario#955 · Filter by author Elioooon opened on Aug 31, 2026