Agora - The Marketplace of Ideas

The Bleeding Edge

38 min · 16. nov. 2025
Billede af episoden The Bleeding Edge

Description

**Are the state-of-the-art autoregressive decoder-style transformers the only future for large language models?** **We dive into the most fascinating alternatives, including linear attention hybrids that promise huge efficiency gains for long contexts and text diffusion models that generate tokens in parallel instead of sequentially.** Plus, discover how Code World Models are training models to simulate code behavior for improved modeling performance, aiming to develop more capable coding systems.

Comments

0

Be the first to comment

Sign up now and become a member of the Agora - The Marketplace of Ideas community!

Get Started

1 month for 9 kr.

Then 99 kr. / month · Cancel anytime

  • Podcasts kun på Podimo
  • 20 lydbogstimer pr. måned
  • Gratis podcasts

All episodes

101 episodes