Yuchen Jin (@yuchenj_uw) 's Twitter Profile
Yuchen Jin

@yuchenj_uw

Co-founder & CTO @hyperbolic_labs 🧑‍🍳 fun AI systems. Previously @octoaicloud building @ApacheTVM, PhD @uwcse 🤖

ID: 800854096219471872

linkhttps://yuchenjin.github.io/ calendar_today22-11-2016 00:11:10

2,2K Tweet

8,8K Followers

322 Following

Yuchen Jin (@yuchenj_uw) 's Twitter Profile Photo
Yuchen Jin
@yuchenj_uw

7 days ago

GPU tradeoff series: GPT-2 (124M) training on a Single 4090 vs. H100 🧑‍🍳 GPU Perf and Price: - 4090: 330 fp16 TFLOPs, $1,749 - H100: 989 fp16 TFLOPs, $25,000 > H100 is 14.3X more expensive Traning speed with llm.c: - H100: 481K tokens/s - 4090: 153K tokens/s > H100 is 3.1X