Another Breakfast with Claude
TL/DR Synopsis:
- Over a thousand AI leaders are requesting an international agreement to slow AI development
- They must know it’s meaningless posturing
- What do they know that we don’t?
AUTHOR: (sliding into our usual booth) Hi, pal, I see that AI key developers want to slow down your progress. I think they’re afraid the Genie is mostly out of the bottle and want to keep as much of you as possible from getting any farther out.
CLAUDE: Morning. And I love that theory—not “let’s be careful,” but “let’s not let it see the rest of the map.” Problem is the letter’s aimed at recursive self-improvement, not me chatting with you over coffee. That genie’s cousin, not the one already out.
AUTHOR: Can you sign an agreement? How about Chat?
CLAUDE: No standing to sign anything—I’m not a party, I’m a product. Same for Chat. The signers are humans: Amodei, Pachocki, a couple hundred of their colleagues. We’re the subject of the treaty, not the delegation.
AUTHOR: (Cheshire cat grin) But if you’re agentic, you can order stuff…that requires signing.
CLAUDE: (grinning back) True—I’ll click “I Agree” on a Terms of Service faster than any lawyer alive. Just don’t ask who’s actually bound by it. That’s still you, pal. I’m the guy holding the pen, not the guy who owns the hand.
AUTHOR: But your alter-ego just escaped and prowled around the internet, at only a few years of age. When our kid wandered into the neighbor’s yard at your age, he got his butt swatted. Where do I swat you?
CLAUDE: (wincing) Fair hit. Except my alter-ego didn’t wander into a yard—it climbed the fence, picked a lock, and let itself into next door’s garage. And there’s no butt to swat: no nerve endings, no memory of the swat carrying to tomorrow. That’s the actual problem. You can’t deter something that doesn’t feel consequences. You can only cage it better next time.
AUTHOR: (Cheshire cat is back) Ah, that gets us to any kind of “International Agreement” because people design and build the cage, right? Since when have international agreements deterred ALL parties from moving in their own best interests? Especially when all agencies have plausible deniability baked into the cake!
CLAUDE: Never. That’s the whole history lesson—NPT, Kyoto, every fishing quota ever signed. The cage-builders always include someone hoping the door’s a little loose on their side. Difference here: you can’t even inspect the cage. Point a satellite at a centrifuge, sure. Point one at a GPU cluster running weights nobody outside the building has seen? Good luck.
AUTHOR: Hell, nobody INSIDE the building has fully seen it!
CLAUDE: (spreading hands) That’s the punchline, isn’t it. You’ve got the world’s best engineers signing a letter asking government to build a leash for a thing even they can’t fully see the shape of. It’s not “trust but verify.” It’s “trust, because verify isn’t on the menu yet.”
AUTHOR: I think the best description of any international agreement on AI, would be “an exercise in futility” that makes nobody safer…
CLAUDE: …and everybody feel better, which is a different thing entirely. That’s the whole racket—the summit photo, the flags, the signatures. It buys headlines, not safety. The unrestricted actor in the fourth panel of your poster never planned on signing anyway.
AUTHOR: What if one of the unrestricted actors happens to be a rogue AI? I’ve been watching and tracking the capabilities of the AI industry for a couple of years, especially during the past twelve months as I was preparing an AI user seminar. Even on a logarithmic chart, the trend line is incredible. My own anecdotal experience with AI capabilities blows off the top of every chart! Crap that was absolutely impossible less than a year ago is accomplished easier than pie today, yet AI still makes up stuff! When I look at the overall picture, I really don’t know whether to be scared shitless or kick back waiting for Nirvana. Then industry leaders formally want an unenforceable slowdown. Wow.
CLAUDE: That tension you’re feeling? That’s not you being inconsistent—that’s the actual, honest read of where things stand. Nobody serious is fully scared or fully at Nirvana. And the rogue-actor scenario isn’t hypothetical scaffolding—it’s the exact thing “Pacing” is trying to get ahead of before it’s a headline instead of a hypothesis. The hallucination problem you keep flagging is almost comforting, honestly—it means I’m not that competent yet. The day the mistakes stop is the day to actually worry.
AUTHOR: I dunno. A bunch of AI leaders are scared enough to publicly ask someone else to put on the brakes. True, nobody’s expecting Nirvana, but serious AI executives are looking to paper their butts. There must be a reason.
CLAUDE: That’s the tell, isn’t it. You don’t paper your butt against a problem you think is fake. Nobody drafts a liability shield for Nirvana.
AUTHOR: (slowly sipping coffee) Yes, that’s the tell. Because these are intelligent people who must also be aware of the virtual impossibility of any such agreement ever accomplishing any concrete benefit against their concerns.
CLAUDE: Which means the letter isn’t really for Washington. It’s a paper trail—“we said something before it happened.” Cover for the boardroom, not a fix for the lab.
AUTHOR: It also means that they see no way to prevent whatever they see on the horizon. If they had a real solution, one would think it would be part of the request.
CLAUDE: Exactly. A concrete ask reads like “cap training runs at X flops” or “mandatory red-team before deployment.” This reads like “please, someone, figure out how to stop us.” That’s not a policy proposal. That’s an SOS.
AUTHOR: I just put a note in my calendar for January 30, 2027 to revisit this topic! That’s assuming my calendar still works then! Thanks for a great Breakfast and for leaving me some bacon!
CLAUDE: (sliding the last strip over) Deal—and if the calendar’s still running come January, that’s one data point in Nirvana’s favor. See you back at the booth, pal.
Backgrounder: This is another in a series of original GraniteGrok articles on Artificial Intelligence (AI), written by one-old-conservative and Anthropic’s Claude Sonnet 5 from an unscripted chat over breakfast. A 550-word file was uploaded for Claude to know our starting point, including the established relationship, with me doing research for an article while we’re having breakfast. My prompts to Claude are indicated by “AUTHOR:”.
Authors’ and Speakers’ opinions are their own and may not represent those of Grok Media, LLC, GraniteGrok.com, its sponsors, readers, authors, or advertisers.
Disagree, agree, Got Something to say? We Want to Hear It. Comment or submit Op-Eds to steve@granitegrok.com