Mtp logprobs2#1

Open

Shang-Pin wants to merge 9 commits intodeep-main-2025-05-22from

Commits on Jun 6, 2025

fix log probs and add for mtp
Shang-Pin Sheng
committed

Commits on Jun 9, 2025

mtp logprobs cuda
Shang-Pin Sheng
committed

Commits on Jun 12, 2025

fix completion
Shang-Pin Sheng
committed

Commits on Jun 16, 2025

logprobs use diff
Shang-Pin Sheng
committed
Downgrade NCCL version from 2.26.5 to 2.25.1 (#4931)

yiqingy0
authored and
Shang-Pin Sheng
committed
pin flashinfer due to compat break

pathorn
authored and
Shang-Pin Sheng
committed

Commits on Jun 18, 2025

fix crash
Shang-Pin Sheng
committed
fix crash without logprobs
Shang-Pin Sheng
committed

Commits on Jun 24, 2025

change serve.py model
Shang-Pin Sheng
committed