Dimitris Papailiopoulos (@dimitrispapail) 's Twitter Profile
Dimitris Papailiopoulos

@dimitrispapail

researcher @MSFTResearch; prof @wisconsin (on leave); thinking about transformers; learning in context; babas of Inez Lily

ID: 573817445

linkhttp://papail.io calendar_today07-05-2012 17:26:48

6,6K Tweet

12,12K Followers

991 Following

Dimitris Papailiopoulos (@dimitrispapail) 's Twitter Profile Photo
Dimitris Papailiopoulos
@dimitrispapail

21 days ago

interesting paper with counterintuitive findings: Synthetic data from cheaper/weaker models can lead to better finetuning results in comparison to sampling from a more expensive/capable model, as you can sample way more at the same price As long as there's signal that is :)