Yi Tay (@yitayml) 's Twitter Profile
Yi Tay

@yitayml

chief scientist / cofounder @RekaAILabs 🫠 | past: research scientist @Google Brain 🤯 | currently learning to be a dad 🍼

ID: 790033937531703296

linkhttp://yitay.net calendar_today23-10-2016 03:35:43

3,3K Tweet

32,32K Takipçi

88 Takip Edilen

Yi Tay (@yitayml) 's Twitter Profile Photo
Yi Tay
@yitayml

7 months ago

Long overdue but here's a new blogpost on training LLMs in the wilderness from the ground up 😄🧐 In this blog post, I discuss: 1. Experiences in procuring compute & variance in different compute providers. Our biggest finding/surprise is that variance is super high and it's

Long overdue but here's a new blogpost on training LLMs in the wilderness from the ground up 😄🧐 In this blog post, I discuss: 1. Experiences in procuring compute & variance in different compute providers. Our biggest finding/surprise is that variance is super high and it's