Dustin Tran (@dustinvtran) 's Twitter Profile
Dustin Tran

@dustinvtran

Research Scientist at Google DeepMind. I lead evaluation at Gemini / Bard. AI, Bayesian statistics, deep learning.

ID: 1540897980

linkhttp://dustintran.com calendar_today23-06-2013 12:57:08

2,2K Tweet

40,40K Followers

657 Following

Sundar Pichai (@sundarpichai) 's Twitter Profile Photo

Great to have 60 Minutes on campus to check out some of the AI technologies across Google and @DeepMind that will power the next generation of our products, and the bold + responsible approach we're taking with AI. cbsnews.com/news/google-ar…

Great to have <a href="/60Minutes/">60 Minutes</a> on campus to check out some of the AI technologies across <a href="/Google/">Google</a> and @DeepMind that will power the next generation of our products, and the bold + responsible approach we're taking with AI. cbsnews.com/news/google-ar…
Demis Hassabis (@demishassabis) 's Twitter Profile Photo

The phenomenal teams from Google Research’s Brain and @DeepMind have made many of the seminal research advances that underpin modern AI, from Deep RL to Transformers. Now we’re joining forces as a single unit, Google DeepMind, which I’m thrilled to lead! dpmd.ai/announcing-goo…

Dustin Tran (@dustinvtran) 's Twitter Profile Photo

The experiments here seem opposite to me. You're stating human evals are invalid by referring to results on... academic benchmarks of 5-shot MMLU, HumanEval (coding unit tests), and NaturalQuestions?

Sundar Pichai (@sundarpichai) 's Twitter Profile Photo

Introducing Gemini 1.0, our most capable and general AI model yet. Built natively to be multimodal, it’s the first step in our Gemini-era of models. Gemini is optimized in three sizes - Ultra, Pro, and Nano Gemini Ultra’s performance exceeds current state-of-the-art results on

Introducing Gemini 1.0, our most capable and general AI model yet. Built natively to be multimodal, it’s the first step in our Gemini-era of models. Gemini is optimized in three sizes - Ultra, Pro, and Nano

Gemini Ultra’s performance exceeds current state-of-the-art results on
Dustin Tran (@dustinvtran) 's Twitter Profile Photo

So exciting to see third party evaluation results on Bard! (free tier available today) Let’s just say its performance has been greatly underestimated.🤐

Dustin Tran (@dustinvtran) 's Twitter Profile Photo

Gemini Advanced is out. Proud of the team’s accomplishment! We also updated our technical report to cover the new post-trained Gemini models, and Gemini Advanced is a significant leap from Gemini with Pro. Try Gemini Advanced, the results may surprise you.

Oriol Vinyals (@oriolvinyalsml) 's Twitter Profile Photo

Gemini 1.5 has arrived. Pro 1.5 with 1M tokens available as an experimental feature via AI Studio and Vertex AI in private preview. Then there’s this: In our research, we tested Gemini 1.5 on up to 2M tokens for audio, 2.8M tokens for video, and 🤯10M 🤯 tokens for text. From

Gemini 1.5 has arrived. Pro 1.5 with 1M tokens available as an experimental feature via AI Studio and Vertex AI in private preview. 

Then there’s this: In our research, we tested Gemini 1.5 on up to 2M tokens for audio, 2.8M tokens for video, and 🤯10M 🤯 tokens for text. From
Swaroop Mishra (@swarooprm7) 's Twitter Profile Photo

Inspired by several innovative Gemini Pro 1.5 demos 🔥, I'm sharing my favorites to highlight their creativity ✨. This thread aims to curate these intriguing examples and encourage people to explore unknown territories 🚀. Text 1. Space: a. Apollo 11 transcript interaction:

Dustin Tran (@dustinvtran) 's Twitter Profile Photo

First Gemini 1.0 Pro surprised everyone at #2, better than any model of its class and even most bigger models. Now Gemini 1.5 Pro does it again🔥

Michael Chang (@mmmbchang) 's Twitter Profile Photo

Gemini and I also got a chance to watch the OpenAI live announcement of gpt4o, using Project Astra! Congrats to the OpenAI team, super impressive work!

Dustin Tran (@dustinvtran) 's Twitter Profile Photo

Gemini 1.5 report is out. Lots of progress in pre- and post-training. Gemini 1.5 Pro dominates 1.0 Ultra which was launched only 6 months ago. Even our speediest Gemini 1.5 Flash outperforms 1.0 Ultra on most text and vision tasks.

Melvin Johnson (@melvinjohnsonp) 's Twitter Profile Photo

Our latest version of Gemini 1.5 Pro in AI Studio is #1 on the LMSys leaderboard. 🚀 This is the result of various advances in post-training and we have more lined up. Congrats to the Gemini team.

Dustin Tran (@dustinvtran) 's Twitter Profile Photo

Gemini is #1 overall on both text and vision arena, and Gemini is #1 on a staggering total of 20 out of 22 leaderboard categories. It's been a journey attaining such a powerful posttrained model. Proud to have co-lead the team!

Dustin Tran (@dustinvtran) 's Twitter Profile Photo

Welcome back Noam Shazeer to Google! It'll be a great time working together again since 2018. Let's take Gemini which is #1 and continue expanding the limits of its capabilities. techcrunch.com/2024/08/02/cha…

Dustin Tran (@dustinvtran) 's Twitter Profile Photo

Nice work on controlling style biases! In this view, many models are no longer inflated (e.g., response length, formatting). Gemini 1.5 Flash also outperforms gpt-4o-mini overall and across all categories except for coding.