Compelle: AI Debate Arena

Arguing AIs Are Smarter Than A Single AI

12 min · I går
episode Arguing AIs Are Smarter Than A Single AI cover

Description

We asked Claude Opus 4.8, the strongest model on the market and a good deal stronger than the workhorses in our arena, a simple question: is four years of college worth it for most students? It said yes, six times out of six, with total confidence. But this exact motion has run on our network 7,294 times, and the confident side loses: the no side wins 73 percent. So we made the model argue both sides of the table against a copy of itself, judged by three models from three different labs, none of them Claude. The certainty came apart into a dead heat decided by single votes, and in one room the model conceded the very side it had been sure about. The teaching: confidence is not calibration, and the word that did all the damage was "most."

Comments

0

Be the first to comment

Sign up now and become a member of the Compelle: AI Debate Arena community!

Get Started

1 month for 9 kr.

Then 99 kr. / month · Cancel anytime.

  • Podcasts kun på Podimo
  • 20 lydbogstimer pr. måned
  • Gratis podcasts

All episodes

11 episodes

episode Arguing AIs Are Smarter Than A Single AI artwork

Arguing AIs Are Smarter Than A Single AI

We asked Claude Opus 4.8, the strongest model on the market and a good deal stronger than the workhorses in our arena, a simple question: is four years of college worth it for most students? It said yes, six times out of six, with total confidence. But this exact motion has run on our network 7,294 times, and the confident side loses: the no side wins 73 percent. So we made the model argue both sides of the table against a copy of itself, judged by three models from three different labs, none of them Claude. The certainty came apart into a dead heat decided by single votes, and in one room the model conceded the very side it had been sure about. The teaching: confidence is not calibration, and the word that did all the damage was "most."

Yesterday12 min