Beidi Chen
@beidichen
Asst. Prof @CarnegieMellon, Visiting Researcher @Meta, Postdoc @Stanford, Ph.D. @RiceUniversity, Large-Scale ML, a fan of Dota2.
ID: 424387623
https://www.andrew.cmu.edu/user/beidic/ 29-11-2011 18:22:36
387 Tweet
6,6K Followers
355 Following
🤯This study explains my year-long confusion on why #GPT4 leak says OpenAI deployed speculative decoding in their serving last June by Dylan Patel SemiAnalysis because I thought SD is only useful for small batches... Surprisingly speculative decoding can bring more benefits when