Together AI (@togethercompute) 's Twitter Profile
Together AI

@togethercompute

The future of AI is open-source. Let's build together.

ID: 1592266692528197632

linkhttp://together.ai calendar_today14-11-2022 21:23:18

825 Tweet

31,31K Followers

323 Following

Together AI (@togethercompute) 's Twitter Profile Photo
Together AI
@togethercompute

13 days ago

We are excited to share our latest work on speculative decoding for high-throughput inference! Before this work, we thought speculative decoding was useless at large batch sizes since the GPUs would go brrrr from processing all the different inputs. Much to our surprise, we