@lzy_michael : This short report proves that a small sized one layer transformer can not perform induction head task arxiv.org/abs/24508.14332 • TwiDoom

@lzy_michael

+ Follow

Research Fellow at @GatsbyUCL. previously PhD student in machine learning and statistics @OxCSML and @OxfordStats

ID: 729049016399478785

calendar_today07-05-2016 20:43:25

83 Tweet

268 Followers

335 Following

24 days ago

This short report proves that a small sized one layer transformer can not perform induction head task arxiv.org/abs/2408.14332

thumb_up_off_alt31

chat_bubble_outline3

repeat7

shareShare