Study note

Looking Back at Speculative Decoding

Properties

Type
Blogs
Status
待读
Domain
AI / ML
Category
LLM 推理与服务
Source
research.google
Vault note
library/articles/ai_ml/Looking-Back-at-Speculative-Decoding-9cf95185958300ba.md

Summary

Google Research 回顾推测解码的核心思想、研究发展和用小模型草拟 token 来加速大模型生成的路线。

Highlights

提供权威历史脉络,帮助区分算法收益、验证成本和实际部署条件。

Comments

Loading comments...