alphaXiv (@askalphaxiv) 's Twitter Profile
alphaXiv

@askalphaxiv

Adding comment sections to arXiv papers

ID: 1722422481942884352

linkhttp://alphaxiv.org calendar_today09-11-2023 01:15:23

123 Tweet

4,4K Followers

27 Following

alphaXiv (@askalphaxiv) 's Twitter Profile Photo

New from AI at Meta: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts With a 1T token training budget, MoMa 1.4B achieves FLOPs savings of 3.7x πŸš€ Authors Victoria X Lin, Akshat Shrivastava, and Liang Luo will be on alphaXiv this week to answer your questions.

New from <a href="/AIatMeta/">AI at Meta</a>: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts

With a 1T token training budget, MoMa 1.4B achieves FLOPs savings of 3.7x πŸš€

Authors <a href="/VictoriaLinML/">Victoria X Lin</a>, <a href="/AkshatS07/">Akshat Shrivastava</a>, and Liang Luo will be on alphaXiv this week to answer your questions.