The Human in the Loop

When 80% of the Code Isn't Yours

22 min · I går
episode When 80% of the Code Isn't Yours cover

Description

You're still measuring AI by whether it writes good code. That's already the wrong question. Reading Anthropic's latest numbers, more than 80% of the code merged into their codebase is now written by Claude. The typical engineer ships 8x as much code per day as in 2024. And the length of task an AI can finish reliably is doubling roughly every four months. Four-minute jobs two years ago. Twelve-hour jobs now. But "what is the human actually still doing?" Their answer: not writing. Not running experiments. Setting direction. Reviewing. Deciding what's worth building and catching what slipped through. They already run automated Claude reviewers that flag bugs their best engineers missed. That quietly reframes the whole skills conversation. Most of my career has been about making output faster and cleaner. Fewer defects, quicker delivery. If output is becoming close to free, the value moves somewhere else. To judgment. What to build. When to ship. What not to trust. I don't think most IT teams are ready for that shift yet. What do you think? #AI #TheHumanInTheLoop #AILeadership

Comments

0

Be the first to comment

Sign up now and become a member of the The Human in the Loop community!

Get Started

1 month for 9 kr.

Then 99 kr. / month · Cancel anytime.

  • Podcasts kun på Podimo
  • 20 lydbogstimer pr. måned
  • Gratis podcasts

All episodes

31 episodes

episode When 80% of the Code Isn't Yours artwork

When 80% of the Code Isn't Yours

You're still measuring AI by whether it writes good code. That's already the wrong question. Reading Anthropic's latest numbers, more than 80% of the code merged into their codebase is now written by Claude. The typical engineer ships 8x as much code per day as in 2024. And the length of task an AI can finish reliably is doubling roughly every four months. Four-minute jobs two years ago. Twelve-hour jobs now. But "what is the human actually still doing?" Their answer: not writing. Not running experiments. Setting direction. Reviewing. Deciding what's worth building and catching what slipped through. They already run automated Claude reviewers that flag bugs their best engineers missed. That quietly reframes the whole skills conversation. Most of my career has been about making output faster and cleaner. Fewer defects, quicker delivery. If output is becoming close to free, the value moves somewhere else. To judgment. What to build. When to ship. What not to trust. I don't think most IT teams are ready for that shift yet. What do you think? #AI #TheHumanInTheLoop #AILeadership

Yesterday22 min
episode The $36,000 Engineer: When Agentic AI Stops Being a Subscription artwork

The $36,000 Engineer: When Agentic AI Stops Being a Subscription

Uber blew its whole 2026 AI budget in four months. Then it set a $1,500 monthly cap on each coding tool, per engineer. Claude Code, Cursor, a dashboard to watch the spend, an approval step to go over. Simon Willison did the math. Two tools, and one engineer runs about $36,000 a year. For years AI was a flat subscription. You paid once a month and you knew the number. Agentic coding turned that into a metered bill. And a metered bill does not warn you politely. It surprises you. This is the cloud invoice all over again. A team turns something on, forgets it is metered, and finds out at the end of the month. A paper this week put numbers on the risk. 63 real cases where agents blew past their limits. Often a single retry loop, quietly burning thousands before anyone looked. A cap you cannot enforce in code is just a wish. So before you scale agents across a team, the real question is not what the budget is. It is what happens, automatically, the second someone hits the ceiling. Most teams can answer the first. Almost none can answer the second. Full breakdown in this week's episode of The Human in the Loop.

7. juni 202623 min
episode AI Ships Faster Than Anyone Can Review It artwork

AI Ships Faster Than Anyone Can Review It

Meta says AI writes 80% of new code. Their own reviewers can't keep up with their own AI. Straight from their engineering blog. They built RADAR to auto-review low-risk diffs because "the share of diffs receiving timely review has declined." Their words. AI-generated code outpaced human review capacity. Read that with the rest of the week's news. Cognition says Devin merged 7x more PRs year-over-year. AI-written commits inside customer codebases jumped from 16% to 80%. Anthropic shipped Opus 4.8 on Wednesday, and every IDE, gateway, and agent runner had it the same day. They also disclosed a $47B revenue run-rate. The "is this a real business" debate is over. But here is what keeps coming back to me: Shipping more code faster is only a win if the systems that catch problems scale at the same rate. This week, the evidence says they aren't. A new arXiv study of 20,574 real coding-agent sessions documents how often agents do something other than what was asked. ITBench-AA, the first serious benchmark for agentic IT work, scored every frontier model below 50%. Adoption is real. The guardrails are not. This week's episode of The Human in the Loop covers all of it: the shipping wave, the cost-control backlash starting inside eng departments, and why ITBench-AA matters more than the score suggests.

31. maj 202622 min
episode Why Your Coding Agent's PRs Keep Getting Rejected artwork

Why Your Coding Agent's PRs Keep Getting Rejected

The model isn't the problem. I went back through 20 of my agent's pull requests and the failures looked exactly like a junior's first month. 3 of them tried to rewrite things nobody asked them to rewrite. 5 skipped the test, or wrote a test that would have passed either way. 4 fixed the bug but broke something else in the process. I used to assume model quality was the main driver. It isn't. The agent doesn't ship a one-line fix. It opens a change touching twelve files, half of them unrelated to the bug. It writes the code and skips the test. Or it writes a test that proves nothing. But notice that none of these are model problems. They're the same review failures a junior would ship. Just at higher volume and with more confidence. The practical move: stop logging "the agent failed" and start logging why. Counting changed how I prompt and how I scope tickets. It told me more about my codebase than any benchmark score ever has. If your top three match mine, you're seeing what everyone else is seeing. If they differ, that's signal about your codebase or your prompts. What's your top rejection reason? Full breakdown in this week's episode of The Human in the Loop. Link in the comments.

24. maj 202620 min
episode Counting Keystrokes to Prove the Team Can Write artwork

Counting Keystrokes to Prove the Team Can Write

Counting accepted Copilot suggestions to prove AI works is like counting keystrokes to prove the team can write. It is the cleanest number on the dashboard. It is also the one that tells you nothing. Forty years ago Fred Brooks split software work into two parts. The accidental: syntax, boilerplate, scaffolding. The essential: what to build, why, for whom, what to trade off. The accidental is what AI tools are good at. That is why the dashboards look spectacular. Lines generated. Suggestions accepted. Prompts sent. The tools were always going to win that part. The numbers that should actually move sit one layer deeper. Cycle time. Change failure rate. Time to first PR review. Defect density. These were already telling you whether the team was shipping good software, long before AI showed up. AI either bends them or it does not. If cycle time has not moved, suggestion-acceptance is a vanity stat. If change failure rate has not dropped, you are not shipping faster. You are writing more code, faster. If time to first review has not shortened, your reviewers are the bottleneck and Copilot cannot fix that. GitHub shipped team-level Copilot metrics this week. It made the wrong question easier to ignore, not harder. Which second-order metric has actually moved on your team since you rolled out an AI coding tool? Full breakdown in this week's episode of The Human in the Loop.

17. maj 202624 min