Issues

• Seed set A model_seed: what does it seed, and how should a submission without a client setting for it pass seed-runtime-match?

  mlcommons/endpoints_policies#163 · Filter by author vaishalisenthil24 opened on Nov 2, 2026

• Clarification: "MLC Estimated Power" labelling — undefined "comprehensive testing" trigger, and differing scope statements

  EndpointsRulesquestion
  mlcommons/endpoints_policies#161 · Filter by author nv-alicheng opened on Oct 30, 2026

• Clarification: Response timelines within the peer review window

  mlcommons/endpoints_policies#158 · Filter by author anandhu-eng opened on Oct 28, 2026

• Clarification re: intended automation for the 60 day embargo cutoff

  mlcommons/endpoints_policies#156 · Filter by author arav-agarwal2 opened on Oct 27, 2026

• Need rules for using past versions of the submission checker.

  mlcommons/endpoints_policies#153 · Filter by author arav-agarwal2 opened on Oct 19, 2026

• Submission id in system_desc.json

  mlcommons/endpoints_policies#143 · Filter by author attafosu opened on Oct 9, 2026
  1

• Clarify agentic offline submission

  mlcommons/endpoints_policies#142 · Filter by author arekay-nv opened on Oct 9, 2026
  4

  

• Clarification on Performance run dataset scheduler

  mlcommons/endpoints_policies#116 · Filter by author attafosu opened on Sep 4, 2026
  1

• Clarification regarding "link_config"

  mlcommons/endpoints_policies#115 · Filter by author anandhu-eng opened on Sep 4, 2026
  1

• Dispute resolution and objection patch - Update to include Audit procedures

  mlcommons/endpoints_policies#114 · Filter by author nvashutoshd opened on Sep 2, 2026

• Invalidating Runs After Finalization

  mlcommons/endpoints_policies#95 · Filter by author arav-agarwal2 opened on Aug 12, 2026

• System Description Format — Conflicting Field Names and Missing Schema

  bugdocumentationPending-ResolutionStandardized
  mlcommons/endpoints_policies#94 · Filter by author nvashutoshd opened on Aug 12, 2026
  4

  

• Rules inconsistencies

  bugEndpointsRulesPending-ResolutionSubmissionRules
  mlcommons/endpoints_policies#93 · Filter by author nvashutoshd opened on Aug 12, 2026
  

• Define logistics for managing run updates during submission.

  mlcommons/endpoints_policies#91 · Filter by author arav-agarwal2 opened on Aug 11, 2026

• Task specific accuracy datasets + separate perf datasets

  EndpointsRuleshelp wantedquestion
  mlcommons/endpoints_policies#88 · Filter by author arekay-nv opened on Aug 6, 2026
  

• Post-submission confirmation report

  mlcommons/endpoints_policies#86 · Filter by author arav-agarwal2 opened on Aug 5, 2026
  3

• Update Review Chair responsibilities to include peer review

  mlcommons/endpoints_policies#85 · Filter by author nvashutoshd opened on Aug 5, 2026
  2

  

• Rules for Agentic benchmarks

  mlcommons/endpoints_policies#84 · Filter by author nvashutoshd opened on Aug 5, 2026

• Speculative Decoding Rules Update for v1.0 - audit checks

  mlcommons/endpoints_policies#82 · Filter by author krygol opened on Aug 4, 2026
  1

• Speculative Decoding Rules Update for v1.0 - output equivalence verification

  mlcommons/endpoints_policies#81 · Filter by author krygol opened on Aug 4, 2026

• Speculative Decoding Rules Update for v1.0 - draft model requirements

  mlcommons/endpoints_policies#80 · Filter by author krygol opened on Aug 4, 2026
  1

• Speculative Decoding Rules Update for v1.0 - Approval Process Drafters

  mlcommons/endpoints_policies#79 · Filter by author krygol opened on Aug 4, 2026
  2

• Seed update frequency

  EndpointsRules
  mlcommons/endpoints_policies#75 · Filter by author arekay-nv opened on Jul 31, 2026
  1

• Define a process for finalizing submissions as "publication-ready"

  mlcommons/endpoints_policies#74 · Filter by author arav-agarwal2 opened on Jul 31, 2026

• Define a cut-off period for withdrawing submissions

  mlcommons/endpoints_policies#73 · Filter by author arav-agarwal2 opened on Jul 31, 2026
  1