feat(benchmarks): Add log and download source files#1019
Draft
dolaameng wants to merge 7 commits into
Draft
Conversation
6de2f9d to
05eaa10
Compare
97df006 to
76f28a9
Compare
f63fef9 to
47afff7
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
feat(benchmarks): Add
publishandlogcommands, support datasetpush, and improvedownloadTODO: release
kaggle-sdk-pythonnew version and use it here.Publish command (new)
Adds
kaggle b t publish <task> [--publish-backing-notebook]to make a benchmark task public.Log command (new)
Adds
kaggle b t log <task> [-m <model> ...]to view execution logs.RUNNING) runs stream live output via SSE; completed/errored runs print the persisted log.QUEUEDruns (which have no logs yet) by catching the server's 404/400 per-run, printing a friendly indicator, and continuing to show logs for other runs instead of crashing.Push with dataset (new)
Adds
-d/--kaggle-datasettokaggle b t pushto attach Kaggle datasets as data sources.-dwould detach previously associated datasets.Download improvements
--include-source/-s: Also download the kernel session's source notebooks alongside output files.--force/-f: Re-download and overwrite previously downloaded runs instead of skipping them. Downloads to a staging directory first so the previous output is preserved if the download fails.Done: X downloaded, Y skipped.count (and outputsDone: 0 downloaded.consistently on early returns).Refactors & Code Quality
\033[) with static utility helpers (_bold(),_warn(),_error()) that automatically strip color codes when the output stream is redirected (non-TTY, pipes, logs, agents)._format_model_hint()to fix model name quoting inconsistencies._print_log_entry()now prints fallback dictionaries with formatting viajson.dumps()instead of Python's rawrepr().