The dataset is everything.

Great read: nonint.com/2023/06/10/the…

Today at Answer.AI we've got something new for you: FSDP/QDoRA. We've tested it with AI at Meta Llama3 and the results blow away anything we've seen before.

I believe that this combination is likely to create better task-specific models than anything else at any cost. 🧵

New paper from OpenAI on prompt injection - it's the most detailed evaluation of the problem I've seen from them so far, and has some very interesting details

Posted some of my notes on the paper on my log here: simonwillison.net/2024/Apr/23/th…

Most people rejected His message

A claim of consciousness from an LLM has no more evidential value than the same from a character in a dream.

The latter is more plausible a priori as the hardware is known to support it.

New Command R+ from Cohere — 128k context, open weights for non-commercial use, commercial API priced similar to Claude 3 Sonnet

Tokenizer is designed to be efficient in 10 languages so definitely consider for non-English text. Multi-hop tool use sounds interesting too

New Anthropic research suggests if violence doesn't solve your LLM problems you aren't using enough of it.

This Google result is truly impressive when you consider there is no other context in which anyone would note the fact it gives as its answer.

when the humans don’t believe you have a world model so you send a quick snap from the train