Skip to content

feat(speculative): support extract hidden states with vllm backend#273

Merged
yghstill merged 17 commits intoTencent:mainfrom
dawnranger:speculative_vllm_backend
Mar 31, 2026
Merged

feat(speculative): support extract hidden states with vllm backend#273
yghstill merged 17 commits intoTencent:mainfrom
dawnranger:speculative_vllm_backend

Conversation

@dawnranger
Copy link
Copy Markdown
Contributor

No description provided.

@dawnranger dawnranger force-pushed the speculative_vllm_backend branch from 95824fc to b662eb3 Compare March 24, 2026 08:36
yghstill
yghstill previously approved these changes Mar 24, 2026
Copy link
Copy Markdown
Collaborator

@yghstill yghstill left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dawnranger dawnranger changed the title feat: support extract hidden states with vllm backend WIP: feat(speculative): support extract hidden states with vllm backend Mar 24, 2026
@dawnranger dawnranger force-pushed the speculative_vllm_backend branch from c223849 to 7fd8735 Compare March 25, 2026 16:36
@dawnranger dawnranger force-pushed the speculative_vllm_backend branch from d638194 to b07a5b9 Compare March 26, 2026 02:10
@dawnranger dawnranger force-pushed the speculative_vllm_backend branch from b07a5b9 to 71d888b Compare March 26, 2026 02:24
@dawnranger dawnranger changed the title WIP: feat(speculative): support extract hidden states with vllm backend feat(speculative): support extract hidden states with vllm backend Mar 26, 2026
@dawnranger dawnranger force-pushed the speculative_vllm_backend branch from 474fdda to 73bb479 Compare March 30, 2026 12:57
@dawnranger dawnranger force-pushed the speculative_vllm_backend branch from 73bb479 to 563e8d2 Compare March 30, 2026 14:54
@yghstill yghstill merged commit de4f5ec into Tencent:main Mar 31, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants