Skip to content

Support new columnar storage as data source #10844

@yongman

Description

@yongman

Enhancement

Add new columnar storage data source for TiDB X.

The columnar storage data source is generated by TiKV next-gen with tikv-worker. So tiflash don't need to sync and decode the raftlog. So the disaggregated write path (tiflash write node) can be discard and can greatly reduce the burden of code synchronization between TIFlash and TIKV.
For deployed with columnar, only the read path from tiflash compute needs to be maintained. This is because tikv next-gen columnar only handles the generation of the columnar storage format. It still relies on tiflash compute's MPP computing framework to handle complex computational tasks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions