The future is today - “Training 1.8T param GPT model took 8000 Hopper GPUs + 15 MW of power vs now only 2000 Blackwell GPUs + 4 MW” #GTC

Matt Turck’s eagerly awaited AI / ML landscape is out with Fiddler AI leading the AI Observability pack! Huge market attracting many new entrants. 👇

To build or to buy #AIObservability

AI disrupting weddings 🦙

PSA if you want to join a startup but don’t care for equity, you’re better off in a public company.

FM training is the true wild wild west of AI infra - GPU and network faults during SOTA model training look gnarly plus require a ton of checkpointing to recover. Hyper parallelism complicates that further. Great read on the #DBRX build. databricks.com/blog/mosaic-ai…

The transformers paper is a reminder that great work is often contrarian and ignored - but time unlocks its potential. Google created a recipe for unconventional ideas to thrive - the transformers mafia is a 🚀 Fun to read the story behind the paper wired.com/story/eight-go…

A credible point of view with LLMs as developers - scary yet exciting to absorb the ramification of software cost going to zero.

Whichever side you’re on, this one from Leopold Aschenbrenner is a thought provoking read on AI’s future. situational-awareness.ai

Although we’ve been clocking 0.5 OOMs per year - it looks like that is plateauing out. So we need a step change in the form of a new arch - people are skeptical whether this can happen, but a reminder that the Attention paper came out of the blue too. situational-awareness.ai/from-gpt-4-to-…

I had two kids at Fiddler - parenting is a lot more difficult than building a startup. Yet, founders are worshipped while parents are an afterthought. Happy Father’s Day to all the unsung heroes!

Excited to share that Fiddler AI is now helping the U.S. Navy (NWIC-Pac) with #AIObservability for Underwater Target Threat Detection in one of our largest production engagements. The DefenseInnovationUnit (Defense Innovation Unit) has awarded Fiddler AI with a #SuccessMemo and achieved

We're excited to share that Fiddler is included on #Lazard VGB AI Infra 40 list for #MLOps! Read on for the full list and to learn more about key market themes: buff.ly/3WodadE

Please join us tomorrow at the Fiddler AI Explained Webinar for an insightful conversation with the CEO of Anyscale, Robert Nishihara. Anyscale has pioneered AI infrastructure for training and deploying complex ML models and LLMs. They build and maintain one of the most

Great pricing drill down on economics of running llama at $2.8/M tokens - innovation is kicking even at infra scale!

Join us at Data Science Connect's #AlignAI Summit next Wednesday, August 21st in NYC. amit paka 🎻, Fiddler Founder and COO, will give a talk on "AI Observability: The Key to Unlocking the Full Potential of Large Language Models." In this talk, he will explore: 1) The risks and

Happy Independence Day, you big messy democracy!

Another refreshing founder-led execution story at Airbnb (first one being NVidia). Sometimes you need to slow down to speed up. Overlap: Business & Tech @jason