Skip to content

Add config to disable skip status#2011

Merged
vish-cs merged 1 commit into
datacommonsorg:masterfrom
vish-cs:skip
May 14, 2026
Merged

Add config to disable skip status#2011
vish-cs merged 1 commit into
datacommonsorg:masterfrom
vish-cs:skip

Conversation

@vish-cs
Copy link
Copy Markdown
Contributor

@vish-cs vish-cs commented May 14, 2026

This is required for the integration test. We repeatedly run the same import for ingestion during the test. Recently, we added a SKIP state where the import is skipped if there is no data change which happens for the integration test. This change is to force the ingestion even if there is no data change so we can verify the E2E flow.

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a new configuration setting, enable_skip_status, to allow skipping data ingestion when no changes are detected. While the global configuration and manifest overrides were added, the implementation in import_executor.py currently ignores the per-import overrides. Feedback suggests updating the logic to check the import_spec for configuration overrides before falling back to the global default.

Comment thread import-automation/executor/app/executor/import_executor.py
Comment thread import-automation/executor/app/configs.py
Comment thread scripts/us_fed/treasury_constant_maturity_rates/manifest.json
Comment thread import-automation/executor/app/executor/import_executor.py
@vish-cs vish-cs force-pushed the skip branch 2 times, most recently from 623f46c to 73625b8 Compare May 14, 2026 07:23
@vish-cs vish-cs merged commit 853a498 into datacommonsorg:master May 14, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants