Repository navigation
feat: load Planktivore parquet images and localizations - #94
Merged
Merged
Conversation
Remap variable dino3 model columns to label and score so aidata load boxes can ingest ISIIS parquet classifications. Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
…ount" This reverts commit 2afa354.
Keep the client that still exposes tator_openapi.Configuration and ignore Dependabot updates. Co-authored-by: Cursor <cursoragent@cursor.com>
Strip a caller-supplied directory prefix when building hosted image URLs, and reject it when images are uploaded. Co-authored-by: Cursor <cursoragent@cursor.com>
Read png and jpg names from the filename column and join relative paths onto --base-path. Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
…ead of aborting, just print error
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
aidata load boxes, remappingdinov3*columns to label and score, and optionally limiting the media lookup with--section.filenamecolumn withaidata load images:--base-pathlocates relative files, and the hosted URL keeps the path after the config mount. A dry run skips per-file timestamp parsing, and a reference URL that returns 301 stops the load.tatorto 1.2.3 and ignore Dependabot updates for it, so the client that still exposestator_openapi.Configurationstays in place.Fixes #93
Test plan
poetry run pytest tests/test_tap_isiis_parquet.py tests/test_load_images_base_path.py tests/test_find_section_id.pyaidata load imagesagainst a Planktivore parquet with--base-pathand confirm the count returns without parsing every timestamp--max-imagesset and confirm the hosted URL is{base}/{path after mount}and returns 200aidata load boxes --section <section>only matches media in that section