Skip to content

Read a run's metrics back from the DST dashboard - #458

Merged
radiken merged 2 commits into
masterfrom
alan/dashboard-fetch
Nov 17, 2026
Merged

radiken merged 2 commits into
masterfrom
alan/dashboard-fetch

Conversation

@radiken

@radiken radiken commented Nov 11, 2026 •

Copy link
Copy Markdown
Contributor

Adds python -m src.analysis.fetch_run <run folders>: when a run folder has no metric CSVs, it writes them from the dashboard, under the same file names the scrape used (publish now records them). The run is matched on its dashboard title. A dataset with no rows, or stored under a different query than today's scrape, fails the fetch.

@radiken
radiken force-pushed the alan/dashboard-fetch branch from 08bc90f to b1ba943 Compare November 12, 2026 21:37
Base automatically changed from alan/dashboard-publish to master November 17, 2026 11:09
radiken and others added 2 commits November 17, 2026 11:12
…al scrape

run_metrics returns <run>/metrics if the run was scraped there. Otherwise it
finds the run's experiment on the dashboard and writes the stored rows to the
same folder with the scraper's own CSV writer. fetch_run does this for run
folders from the command line.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ry, keep the CSV names

A run folder with metadata.json is matched on the exact title publish
gives it, so runs sharing a folder name stay apart. A listed dataset with
no rows, or stored under another query than today's scrape, fails the
fetch instead of leaving a partial or mislabelled dump. Publish records
the name the run's CSVs share, and the fetch writes the same file names.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@radiken radiken self-assigned this Nov 17, 2026
@radiken radiken added the enhancement New feature or request label Nov 17, 2026
@radiken radiken linked an issue Nov 17, 2026 that may be closed by this pull request
@radiken
radiken marked this pull request as ready for review November 17, 2026 12:05
@radiken
radiken force-pushed the alan/dashboard-fetch branch from b1ba943 to d85e33c Compare November 17, 2026 12:09
@radiken
radiken merged commit 5477f5d into master Nov 17, 2026
2 checks passed
@radiken
radiken deleted the alan/dashboard-fetch branch November 17, 2026 19:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

General tooling (recurring)

2 participants