One year since GPT-4 release. Hope you all enjoyed some time to relax; it’ll have been the slowest 12 months of AI progress for quite some time to come.

Can we build an LLM system to forecast geo-political events at the level of human forecasters?

Introducing our work Approaching Human-Level Forecasting with Language Models!

Arxiv: arxiv.org/abs/2402.18563
Joint work with Danny Halawi, Fred Zhang, and John(Yueh-Han) Chen

The next few years are going to be wilder than almost anyone realizes.

I've been watching this over and over again and it's still hard to believe it's not real.

openai.com/sora

Introducing Sora, our text-to-video model.

Sora can create videos of up to 60 seconds featuring highly detailed scenes, complex camera motion, and multiple characters with vibrant emotions.

openai.com/sora

Prompt: “Beautiful, snowy…

Likewise, this was super fun! Was very cool getting to cube with the guy who taught me F2L (the one part of cubing I was decent at) :)

We’ll miss you <3

Aanish Nair 🟢🟡 oh that ship has sailed, sorry :D
actually one of my favorite meets at OpenAI was a cubing session with two very fast cubers, one of them a former world's record holder. I can't cube anywhere near my prior level anymore so it was a bit embarassing alongside but really fun.

Reminder: applications for the $10M Superalignment grants close Sunday night!

Grad students, academics, researchers: we’d love to work with you, we think there’s a ton of interesting research to do on generalization, scalable oversight, interpretability, and more.

I touched on the idea of sleeper agent LLMs at the end of my recent video, as a likely major security challenge for LLMs (perhaps more devious than prompt injection).

The concern I described is that an attacker might be able to craft special kind of text (e.g. with a trigger…

openai.com/blog/superalig…
This group from OpenAI are among the smartest people i have ever met. I'm very pleased to be one of their supporters, please review and apply to work with them !!!!!!!!!!!!

So happy about this release and grateful to my awesome Preparedness team (especially Tejal Patwardhan), Policy Research, SuperAlignment and all of OpenAI for the hard work it took to get us here. It is still only a start but the work will continue!

I'm extremely impressed by Aleksander Madry Tejal Patwardhan Kevin Liu for developing this Preparedness Framework.

It's a huge step by OpenAI toward stronger AGI safety.

I'm very excited that today OpenAI adopts its new preparedness framework!

This framework spells out our strategy for measuring and forecasting risks, and our commitments to stop deployment and development if safety mitigations are ever lagging behind.

openai.com/safety/prepare…

We are systemizing our safety thinking with our Preparedness Framework, a living document (currently in beta) which details the technical and operational investments we are adopting to guide the safety of our frontier model development.
openai.com/safety/prepare…

new paper! one reason aligning superintelligence is hard is because it will be different from current models, so doing useful empirical research today is hard. we fix one major disanalogy of previous empirical setups. I'm excited for future work making it even more analogous.

New direction for AI alignment — weak-to-strong generalization.

Promising initial results: we used outputs from a weak model (fine-tuned GPT-2) to communicate a task to a stronger model (GPT-4), resulting in intermediate (GPT-3-level) performance.

great work from the superalignment team:

Very impressive work from the Superalignment team just released! Methodology + code is all public & new $10M grant program for new alignment projects.

Excited to launch our paper on making alignment tractable with Collin Burns Pavel Izmailov
Jan Hendrik Kirchner
Bowen Baker
Leo Gao
Leopold Aschenbrenner
Adrien Ecoffet
Manas Joglekar
Jan Leike
Ilya Sutskever
Jeff Wu!

Exploring generalization properties of deep learning to control strong models with weak supervisors, showing early promise.