The hottest new programming language is English

Why is Linux safer than other OS? 😂

Everyone is concerned about how, left to themselves, students will use GPT to do all their homework for them. What happens when you DO give students unfettered access? See our paper! The blog post even gives you a little quiz so you can check your beliefs. blog.brownplt.org/2023/09/19/gen…

Bend the curve 📈

Research summary for the last 3 years... 2021: Replace every CNN with a Transformer 2022: Replace every GAN with diffusion models 2023: Replace every NeRF with Gaussian splatting

Can we talk about the elephant in the room? There's an incentive to centralize and close down AI research so that it can be better commandeered by the govt in the event of WW3. I still think OSS AI can move faster than centralized labs and maintaining a healthy ecosystem is key

before i learned to think i was a rationalist. before i learned to do good i was an ea. before i learned to love i was a communist. before i learned security i was a totalitarian. before i learned to build i was a decel

Project #2: LLM Visualization So I created a web-page to visualize a small LLM, of the sort that's behind ChatGPT. Rendered in 3D, it shows all the steps to run a single token inference. (link in bio)

It's a superpower to be interested in important things that most other people find boring. They'll do them out of duty, if they do them at all. So if you do them out of genuine interest, you'll get a lot further.

Jeff Bezos is an exceptional writer: “The universe wants you to be typical- in a thousand ways it pulls at you. Don’t let it happen.” From letters to shareholders (1997).

This is huge! Now watch the LLM API costs dropping even further. [.cn PDF link] ipads.se.sjtu.edu.cn/_media/publica…

People often email me with big-sounding ideas (reinvent commerce, change the way people meet, transform scientific research), and the bigger the idea sounds, the less interested I am. Truly big ideas don't sound big initially.

AI Spotify is happening

Part of our brains neural tissue is 7 layers of neural nets each doing their own all-to-all operations. Part of Mixtral8x7b neural tissue is 32 layers of neural nets each doing their own matmul operations. Pic:Jim Keller on AI chip design(who also built TeslaHW3,iPhoneSoC,AMDs)

The business reason why open source AI platforms will win.

I heard a wonderful analogy for AI progress from Demis Hassabis : It's hard to imagine the industrial revolution if we didn't happen to have dinosaurs under ground that we could use as fossil fuel. Without them, we'd need to wait to discover solar or nuclear. It's hard to

Ded one high-level example: i find that it's easier to have a more productive debate (especially when it comes to ai safety-related issues), once i recognize that someone leans more deontological vs. utilitarian. having that vocab (?) and calling it out means that we're not trying

years will increasingly cease to look anything alike

Casey Handmer, PhD's beautiful defense on every criticism ever laid on Elon Musk, particularly by John Oliver. Casey, the author, is a fairly distinguished hardware entrepreneur, not a professional entertainer. I wish we celebrated innovation more instead of constantly tearing it down.

Technology maturity isn’t sufficient to drive adoption Insightful analysis of the rise of tractors in US farms, put in parallel with Generative AI, by The Economist AI adoption and subsequent socio-economic impact will take years, if not decades Time to prepare, not to panic