[CK] Add FP8 KV_BLOCKSCALE support for batch prefill#3696
Open
Jeff-Huang wants to merge 1 commit intodevelopfrom
Open
[CK] Add FP8 KV_BLOCKSCALE support for batch prefill#3696Jeff-Huang wants to merge 1 commit intodevelopfrom
Jeff-Huang wants to merge 1 commit intodevelopfrom