Exactly right

A conversation with @JonathanRoss321, founder of @GroqInc. This is the first podcast that Jonathan talks about his $20 billion partnership with NVIDIA. In this conversation, we talk about his decade building Groq: why West Coast VCs kept passing on the company, how fast Jensen works, overcoming near-death experiences, and why he thinks the entire AI age turns on a single skill — knowing what to ask. Hope you enjoy this conversation: 0:00 The $20 Billion NVIDIA Deal Closed In 3 Weeks 0:25 Why GPUs And LPUs Are Better Together 1:46 When AI Talks To AI, Speed Wins 3:30 Always Start With A Hobby Project 5:55 Ask The Right Questions, Not Answer Them 8:23 There Are Infinite Ways To Be A Leader 13:00 I Was One Of The World's Worst Leaders 14:34 Fewer Constraints, More Room To Surprise You 16:31 At NVIDIA There Is No Politics 19:44 You Have To Learn Confidence 22:23 East Coast VCs Think, West Coast VCs Follow 23:50 The Keynesian Beauty Contest Of Silicon Valley 26:48 The Autonomy That Created The NVIDIA Deal 30:07 Making A Model Smarter By Making It Faster 34:52 Reality Quotient Beats Intelligence Quotient 35:44 Find The Dominant Game And Play It 37:11 A Founder's Job Is Full-Time Change Management 38:34 Return On Luck: Seize It Better Than Anyone 42:54 You Can't Sell Speed, You Have To Let People Try It 46:32 I Intend To: Intentional Leadership 51:07 Groq Bonds: Trading Salary For Survival 54:13 Hire For Negatives, Grow For Positives 58:46 Loss Aversion And Booking The Win Early 1:00:37 How Michael Jordan Weaponized Humiliation 1:03:13 Manufactured Discontent Drives Everything 1:05:02 Every Day Without Compute Has A Real Cost 1:07:07 Code Was Rationed, Now It's Nearly Free 1:10:04 Teach Kids To Ask Questions, Not Answer Them Includes paid partnerships.

👀

The LPU team at @nvidia is building the future of low latency inference. We're going all in on Rust. If you're a cracked Rust engineer and love making hardware do things, we want you. nvidia.wd5.myworkdayjobs.com…

America is a nation of builders. For 250 years, America has built railroads, power grids, factories, semiconductors, and the internet. Now, America is building again.

We can finally say AI isn't killing jobs. A new paper from me, @tryramp, and @RevelioLabs uses firm-level spend and workforce data across 21K U.S. businesses to measure AI's impact on jobs. Firms that adopt AI heavily grow headcount 10% over two years following adoption. Low adopters see no statistically significant change.

Founder Tip: Load up on intern energy and naivety. Today's interns are a question away from most knowledge thanks to LLMs, and they haven't yet learned that what you're asking them for is supposed to be impossible.

True

I don’t feel like I have the authority to give advice, but I’ll teach mine the same fundamentals I learnt in college… physics, math, logic (if they’re STEM oriented). AI or not, these things don’t change and train your brain to be analytical.

Curious about GPU💚LPU?

👏 Congratulations to the @Oracle Cloud team on being among the first to bring up NVIDIA Vera Rubin NVL72. Together, we're delivering the infrastructure for the agentic AI era.

Jevons paradox in terms of the Opus → Fable release. 1: Fable drafts all replies. I just approve. I get my life back. 2: Sending is cheap. I send 10x more. I trade some life back for productivity. 3: Everyone hits Phase 2. I can't keep up with approving the replies. Less life than before Phase 1. Better models → more productivity → demand for even better models →

As I wrote this, I saw X go into meltdown over tokens. You've seen the headlines: “Uber blows yearly AI budget in just one quarter.” “Meta employee burns 281 billion tokens in April.” But, the problem isn't spending. Spending works. Since 2023, the top quartile of our AI spenders doubled their revenue. The bottom quartile? Flat. It's blind spending. We don’t know which spend worked. A sales team has qualified leads. A support team has resolved conversations. These are units you can measure against. All a token tells you is the meter ran, not whether the work was worth it or not. Finance says, “half the budget,” engineering says, “double it” and you don’t know who’s right because there is no shared language of value. There’s no attribution, and no attribution means no allocation. For example, right now, all work, no matter the size or shape, defaults to frontier models. But meeting summaries and calendar updates don’t require GPT-5.5 Pro. In isolation this seems trivial, but re-route just 10% of a $10M AI bill from frontier to GPT-4 level intelligence you’ve saved nearly one million dollars. This sounds like a made-up stat — it’s not. It truly is that much cheaper. This is the future of finance: not blindly rubber-stamping or rejecting AI spend, but allocating it with the same rigor companies apply to headcount.

spent my 11-hour flight back from europe working on a very long report. started as a slack message but morphed into a several pages long doc. wifi was as shitty as it gets. after finally making it home i realized that the computer had forcefully restarted. opened slack: draft was gone :( hail mary: claude pls save me, no clue how but pls try it checked APFS snapshots, time machine, slack indexeddb, write-ahead logs, service worker / http caches, local storage, app logs, hibernation image... nothing. all gone but then... it realized i have alfred installed. so it checked the clipboard snapshots alfred keeps in sqlite. sad news: alfred clipboard memory gets deleted after 24h. aggressive retention policy. however! when sqlite runs DELETE, nothing gets actually deleted. it only marks pages as reusable, but it doesn't override the physical bytes. so claude decided to do a raw-scan of the db, reverse eng alfred data format, figure out the portion containing the timestamp, stitched everything back together across overflow pages... and handed me the exact final version of my report, the last one i cmd C'd all this, in a single shot ... day 200 of "what if you had an elite hacker you can ask anything to"

After AlphaGo, the skill of human Go players noticeably improved. I suspect we will see a similar pattern in math.

Q: How are job postings for software engineers rising rapidly despite AI agents automating coding? A: Because there’s far more code to manage than ever before. We’re already seeing a 14x YoY increase in GitHub commits, and it’s accelerating. AI has dramatically lowered the cost of writing code, so it’s now being used across far more businesses, applications, and use cases. We’re at the beginning of a massive productivity boom driven by the proliferation of bespoke software throughout the entire economy. Coding has been AI’s breakout use case this year. The fact that it’s increased demand for software engineers — rather than decreased it — should call into question the entire “AI will cause mass job loss” narrative.

It would take ~1.3 million of these to store the weights of a 1T parameter model at FP16…

Jensen - We need a lot more $NVDA GPUs 😂

Many people outside the tech industry are not fully grasping the latest advancements. the-decoder.com/fields-medal…

Attention is all you need. AI's is endless. Yours isn't. Give it the toil. Keep the taste.