Skip to content

Google Export Pipeline Update#1558

Closed
thecloudman wants to merge 4 commits intodevfrom
features/xcloud
Closed

Google Export Pipeline Update#1558
thecloudman wants to merge 4 commits intodevfrom
features/xcloud

Conversation

@thecloudman
Copy link
Collaborator

@thecloudman thecloudman commented May 1, 2025

🛠️ Description

Updated the pipeline code with new code - this new format does a number of checks before exporting and importing google files. It will check for last export time and validate if new files exist before exporting files. This ensures we only fetch new data from google. There is also a hub iport time section now, this will validate the last import time againsts the last export time, this step prevents duplciating file imports.

Fixes #

📷 Screenshots

📋 Checklist

🔬 How did you test this change?

  • 🤏 Lint tests
  • 🤞 PS -WhatIf / az validate
  • 👍 Manually deployed + verified
  • 💪 Unit tests
  • 🙌 Integration tests

🙋‍♀️ Do any of the following that apply?

  • 🚨 This is a breaking change.
  • 🤏 The change is less than 20 lines of code.

📑 Did you update docs/changelog.md?

  • ✅ Updated changelog (required for dev PRs)
  • ➡️ Will add log in a future PR (feature branch PRs only)
  • ❎ Log not needed (small/internal change)

📖 Did you update documentation?

  • ✅ Public docs in docs (required for dev)
  • ✅ Internal dev docs in src (required for dev)
  • ➡️ Will add docs in a future PR (feature branch PRs only)
  • ❎ Docs not needed (small/internal change)

Graham and others added 3 commits April 28, 2025 01:26
Co-authored-by: Michael Flanakin <flanakin@users.noreply.github.com>
Co-authored-by: Robel Mamecha <59753782+ro100e@users.noreply.github.com>
Co-authored-by: Hélder Pinto <hepint@microsoft.com>
Co-authored-by: Hélder Pinto <helder.pinto@microsoft.com>
Co-authored-by: Michael Flanakin <micflan@microsoft.com>
@microsoft-github-policy-service microsoft-github-policy-service bot added the Needs: Review 👀 PR that is ready to be reviewed label May 1, 2025
@thecloudman thecloudman marked this pull request as ready for review May 1, 2025 23:27
@thecloudman thecloudman changed the title grahamm/xcloud Google Export Pipeline Update May 2, 2025
@flanakin flanakin added this to the Cross-cloud support milestone May 2, 2025
@thecloudman thecloudman closed this May 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Needs: Review 👀 PR that is ready to be reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants