Skip to content

fileserver: migrate pingcap/tidb artifact downloads to OCI registry#4274

Draft
Copilot wants to merge 6 commits intomainfrom
copilot/migrate-artifacts-to-oci-709caa4d-4398-4454-8fe4-149cf7c496d8
Draft

fileserver: migrate pingcap/tidb artifact downloads to OCI registry#4274
Copilot wants to merge 6 commits intomainfrom
copilot/migrate-artifacts-to-oci-709caa4d-4398-4454-8fe4-149cf7c496d8

Conversation

Copy link
Contributor

Copilot AI commented Feb 28, 2026

Removes all fileserver.pingcap.net references from pingcap/tidb pipelines and jobs, replacing binary artifact fetching with OCI pulls via hub-zot.pingcap.net/mirrors/hub.

Core pattern change

Before:

environment { FILE_SERVER_URL = 'http://fileserver.pingcap.net' }
// ...
component.fetchAndExtractArtifact(FILE_SERVER_URL, 'tikv', REFS.base_ref, ...)
component.fetchAndExtractArtifact(FILE_SERVER_URL, 'pd',   REFS.base_ref, ...)

After:

environment { OCI_ARTIFACT_HOST = 'hub-zot.pingcap.net/mirrors/hub' }
// ...
final OCI_TAG_PD   = component.computeArtifactOciTagFromPR('pd',   REFS.base_ref, ...)
final OCI_TAG_TIKV = component.computeArtifactOciTagFromPR('tikv', REFS.base_ref, ...)
// ...
container("utils") {
    dir("bin") {
        retry(3) {
            sh label: 'download tidb components', script: """
                ${WORKSPACE}/scripts/artifacts/download_pingcap_oci_artifact.sh \
                    --pd=${OCI_TAG_PD} --tikv=${OCI_TAG_TIKV}
            """
        }
    }
}

Changes by category

  • ~60 integration/check2 test pipelines (release-6.x → release-9.0-beta, latest): replaced fetchAndExtractArtifact for tikv/pd with OCI download; added OCI_TAG_* declarations; added utils sidecar container to pod templates where missing
  • ~13 build pipelines (pull_build, ghpr_build): removed fileserver artifact upload steps and CI-flag curl uploads — builds no longer push to fileserver
  • periodics_integration_test.groovy: rewrote to use OCI download, removed sha1-based fileserver tracking
  • Tiflash integration tests: added OCI_TAG_TIFLASH; replaced tiflash binary and vector-search test data downloads (now pulled from ann-benchmarks.com)
  • Sqllogic pod templates: init containers now use oras pull from OCI registry instead of wget from fileserver
  • pull_br_integration_test_next_gen/download_tools.sh: localstack binary now fetched from GitHub Releases; removed deprecated tikv-importer download helper
  • release-6.x/ghpr_unit_test.groovy: codecov binary now downloaded from uploader.codecov.io; fileserver-based junitUrl cleared
  • prow-jobs/pingcap/tidb/latest-periodics.yaml: updated stale commented-out codecov URL
Original prompt

This section details on the original issue you should resolve

<issue_title>fileserver: migrate artifacts for pingcap/tidb</issue_title>
<issue_description>Replace fileserver.pingcap.net usage for pingcap/tidb with OCI artifacts in a standard registry.

Acceptance criteria:

  • No fileserver.pingcap.net references in jobs/pipelines for pingcap/tidb
  • Artifacts pulled via OCI registry with documented paths
    </issue_description>

Comments on the Issue (you are @copilot in this section)


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

@ti-chi-bot
Copy link

ti-chi-bot bot commented Feb 28, 2026

Hi @Copilot. Thanks for your PR.

I'm waiting for a PingCAP-QE member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Co-authored-by: wuhuizuo <2574558+wuhuizuo@users.noreply.github.com>
…public uploader

Co-authored-by: wuhuizuo <2574558+wuhuizuo@users.noreply.github.com>
@ti-chi-bot
Copy link

ti-chi-bot bot commented Feb 28, 2026

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from wuhuizuo. For more information see the Code Review Process.
Please ensure that each of them provides their approval before proceeding.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Copilot AI changed the title [WIP] Migrate artifacts for pingcap/tidb to standard OCI registry fileserver: migrate pingcap/tidb artifact downloads to OCI registry Feb 28, 2026
@wuhuizuo
Copy link
Contributor

wuhuizuo commented Mar 5, 2026

@copilot you pr has conflicts

Copy link
Contributor Author

Copilot AI commented Mar 5, 2026

@copilot you pr has conflicts

The conflicts have been resolved — a merge commit (92c0361) from main has been applied to the branch, bringing it up to date.

@wuhuizuo
Copy link
Contributor

wuhuizuo commented Mar 5, 2026

Split release-8.5 changes out to sub PR #4293 (tracked by #4292).

This PR branch has been updated to drop all pipelines/pingcap/tidb/release-8.5/** changes so they can be reviewed independently.

ti-chi-bot bot pushed a commit that referenced this pull request Mar 5, 2026
#4293)

## Summary
- split out `pipelines/pingcap/tidb/release-8.5/**` changes from #4274
into a standalone PR
- migrate `release-8.5` pipelines away from `fileserver.pingcap.net` to
OCI artifact pulls
- keep implementation pattern aligned with migrated `latest` jobs
(`OCI_TAG_*` + `download_pingcap_oci_artifact.sh` via `utils` container)

## Scope
- 30 files under `pipelines/pingcap/tidb/release-8.5/`

## Validation
- Jenkinsfile validation succeeded for all changed Groovy files via
`.ci/verify-jenkins-pipeline-file.sh`

Ref #4274
Fixes #4292
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

fileserver: migrate artifacts for pingcap/tidb

2 participants