PetaFLOP/s-days is a terrible unit. I propose the 'person' = 20 PFLOPS, and the 'person-year'.

GPT-3 was 1024 A100s for 34 days.
(1024*312e12*34 / (20e15*365))
1.5 person-years

GPT-4 was 25k A100s for 90 days.
(25e3*312e12*90 / (20e15*365))
96 person-years

Feels right.

Thermodynamics is to Energy as <???> is to Intelligence

.comma is hosting an elite, 20 person, IRL hackathon the weekend of 9/29. We have robots to play with and a great dev platform. Apply now!

How many years until robotic maids and chefs? blog.comma.ai/comma_hack_4/

We are a lot closer to the Landauer limit (lowest amount of energy for a gate) than I thought.

This chart isn't up to date, but assuming we got 2 more orders of magnitude in the last 13 years, we're at 1e-19 J. The limit is 3e-21 J. Only 10-100x off!

Moore's law ends soon?

Mihai Balint George Hotz 🌑 free/near free energy unlocks a chain of things that will lead to space holidays. firstly it will dump the prices of anything where energy is a big input, that will have network effects in every single market, etc. By far the biggest indicator of well being is energy consumption

hehe I try. I don't want to take over the world or dominate others, I would just like to keep existing with some semblance of freedom.

set off into space with frens, some bio-stack and some silicon-stack. space is big enough for all of us.

AMD (unlike Qualcomm) is a joy to buy chips from. 7.38 PFLOPS of compute was delivered today, with exaflops more to come.

Nice to see them more active on the ROCm GitHub, we are working on the layer above the tiny corp

tinybox in a living room, vaporwave, volumetric light, octane render, hyperrealistic

Our ML simulation is getting better. This video is entirely imagined by a neural network.

I'm offering due diligence as a service. Before you invest millions into an AI or hard tech startup, hire me for $10K. I will evaluate feasibility of idea and realisticness of timeline given founder.

Send money before reach out, PayPal [email protected]. Will refund if not a fit

if you liked my Lex podcast, here's five links that shaped how I think. gems of a decaying internet. take some time on this Independence Day and read them.

web.archive.org/web/2007061318…
catb.org/~esr/faqs/hack…
ranprieur.com/essays/dropout…
unqualified-reservations.org/2008/04/open-l…
localroger.com/prime-intellec…

we may not agree on many things, but this is one of the easiest changes the US can make that radically brightens our potential future.

it's literally free money for our country. and I don't know about you, but I like living in a rich country with smart people.

Is there a difference between the AI control problem and the human control problem? And if you are (still) here for the drama, I talk about my Twitter internship. youtube.com/watch?v=dNrTrx…

Today we open-source a dataset of 100k heavily compressed driving videos for machine learning experiments.

We included the encoder, the decoder, and the GPT model that generated the video below.

There are 2 challenges with $500 reward each.
github.com/commaai/commavq

A good intro to the tiny corp for people who want to come work here. youtube.com/watch?v=K5iDUZ…

Also the tiny corp is back on the 'get AMD on MLPerf plan'. Spoke with Lisa Su, I do believe things will get better and AMD will begin to develop in public.

1) Help out by doing bounties! $1,000 for finishing up the RDNA3 assembler
2) Preorder a tinybox

tinygrad.org