AK (@_akhaliq) 's Twitter Profile
AK

@_akhaliq

AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗)

dm for promo

follow on Hugging Face: huggingface.co/akhaliq

ID: 2465283662

linkhttps://huggingface.co/akhaliq calendar_today27-04-2014 00:20:12

35,35K Tweet

335,335K Followers

2,2K Following

AK (@_akhaliq) 's Twitter Profile Photo
AK
@_akhaliq

2 months ago

Scaling Retrieval-Based Language Models with a Trillion-Token Datastore Scaling laws with respect to the amount of training data and the number of parameters allow us to predict the cost-benefit trade-offs of pretraining language models (LMs) in different configurations.

Scaling Retrieval-Based Language Models with a Trillion-Token Datastore Scaling laws with respect to the amount of training data and the number of parameters allow us to predict the cost-benefit trade-offs of pretraining language models (LMs) in different configurations.