It's snowing large language models this week in Norway! 1st, the 5th NLPL and HPLT Winter School on LLMs is ongoing now in Skeikampen And 2nd, the LTG has released three fully open generative language models for Norwegian, based on Mistral and BLOOM architectures #NLProc

The HPLT winter school hosted a panel discussion on Large 🦣 vs. Small 🤏 language models with Jan Hajic from Matematicko-fyzikální fakulta Univerzity Karlovy among the panelists.

Attending the HPLT & NLPL Winter School in Skeikampen, Norway was a blast and highly recommended if you are interested in Large Language Models. Bonus: we had our very own take on building a snowman!

HPLT scientific highlights directly from one of the authors : "LTG-BERT: an efficient LM architecture developed within the HPLT project, won the BabyLM challenge. Look forward to our future release of 75 LTG-BERTs for 75 different languages." Thanks David Samuel and congrats!

HPLT partners have explored the effects of multililingual vs monolingual instruction tuning, under a constrained budget and a self-made machine-translated Alpaca-based dataset. Spoiler: go multilingual! Work will be presented at #eacl2024 Findings: arxiv.org/abs/2309.08958

Thanks a lot Bram for making HPLT data available on HF!

We will be presenting the HPLT datasets HOW-TO and insights at LREC COLING 2024 in Torino. Paper already in Arxiv.org: arxiv.org/pdf/2403.14009….

Good news for small languages and LLMs. Paper on open Poro 34B model shows how training on Finnish, English and programming languages creates a very strong Finnish model, that excels in translation and is competitive in generating English and code: arxiv.org/abs/2404.01856

HPLT work on LLMs and TMs presented today at the Czech eInfra conference in Prague by Jan Hajic as an example of today's use of large HPC centres. e-infra.cz/konference-e-i… LINDAT/CLARIAH-CZ Institute of Formal and Applied Linguistics Matematicko-fyzikální fakulta Univerzity Karlovy @unikarlova Vědavýzkum.cz #NLProc

More parallel data from ParaCrawl 👏

Will you be at LREC COLING 2024 next week? HPLT will! 🥳 Don't miss: - our poster on Thursday 23, 15:30, about FastSpell, one of the langID technologies of our dataset pipeline. (paper 1571) - our presentation on Friday 24, 9:20 for all details about HPLT massive dataset (paper 2199)

Europe’s largest private #AI lab #helyes Silo AI, #tribetampere Turun yliopisto - University of Turku’s research group TurkuNLP + HPLT released the 1st multilingual large language model (LLM) for all Nordic languages + English + programming languages. By Tech.eu tech.eu/2024/05/15/sil… #NordicMade

LREC COLING 2024 has arrived! We will presenting our work on how we built the HPLT datasets! 📅 Friday 24th of May ⏰ 9.20h-9.40h 📍Room Londra ⌛️Session D3-S1-R3 - Multilinguality, Machine Translation, and Translation Aids II

Our project, HPLT, in a nutshell. Thanks LT-Innovate for spreading our voice: linkedin.com/pulse/high-per…

Still recovering from the excitement of #lreccoling2024, where we presented the HPLT resources! We introduce: - monoHPLT: monolingual collection covering 75 languages - biHPLT: parallel data for 18 language pairs - multiHPLT: synthetic data obtained through pivoting

HPLT at EAMT2024! Barry Haddow and Pinzhen "Patrick" Chen from EdinburghNLP got many questions about when and how much new HPLT data. Quick reply: autumn and a lot.

📢 Job offer: Work with us! 🤓 Institute of Formal and Applied Linguistics Matematicko-fyzikální fakulta Univerzity Karlovy is looking for 🖥️ a Front-End and ⌨️ a Back-End Java developer to work on 🇪🇺 European Open Science Cloud. More details are at ufal.mff.cuni.cz/jobs. The application deadline is 🗓️ Aug 28.

The MT Marathon continues on its third day! We already had great talks by Ondrej Bojar, Raj Dabre, Vilém Zouhar, and Elizabeth Salesky 👏 and a poster session with 10 posters 🖼️. Today, we continue with more talks, and of course, the week-long hackathon continues with interesting projects.

Today Joseph Attieh and I presented KD4MT in the MT Marathon in Prague organized by Institute of Formal and Applied Linguistics, one of my favourite events of the year! Helsinki-NLP HPLT