Keyon Vafa (@keyonv) 's Twitter Profile
Keyon Vafa

@keyonv

Postdoctoral fellow at @Harvard_Data | Former computer science PhD with @Blei_Lab at @Columbia University | ML + NLP + social sciences

ID: 346719335

linkhttp://www.keyonvafa.com calendar_today01-08-2011 18:43:59

1,1K Tweet

1,1K Followers

634 Following

Keyon Vafa (@keyonv) 's Twitter Profile Photo
Keyon Vafa
@keyonv

3 months ago

New paper: How can you tell if a transformer has the right world model? We trained a transformer to predict directions for NYC taxi rides. The model was good. It could find shortest paths between new points But had it built a map of NYC? We reconstructed its map and found this:

New paper: How can you tell if a transformer has the right world model? We trained a transformer to predict directions for NYC taxi rides. The model was good. It could find shortest paths between new points But had it built a map of NYC? We reconstructed its map and found this: