Talking to AI

Understanding Tokens, Context Windows, and Local LLM Hosting

1 h 8 min · 23. mar. 2026
episode Understanding Tokens, Context Windows, and Local LLM Hosting cover

Description

Paul and Grok (an LLM) examine fundamental aspects of large language models, focusing on how tokens and context windows operate. Tokens, defined as textual units (words or word pieces), are the basis for all model processing and cost calculations. The “context window” is described as the LLM’s short-term memory, determining how much information can be handled at once. The discussion highlights th 🎙️ _Hosted by Paul at Talking to AI — where real people, real problems, and real conversations meet artificial intelligence._

Comments

0

Be the first to comment

Sign up now and become a member of the Talking to AI community!

Get Started

2 months for 19 kr.

Then 99 kr. / month · Cancel anytime.

  • Podcasts kun på Podimo
  • 20 lydbogstimer pr. måned
  • Gratis podcasts

All episodes

57 episodes

episode When AI Writes Songs: Experiencing Emotional Creativity with ChatGPT artwork

When AI Writes Songs: Experiencing Emotional Creativity with ChatGPT

In this episode, Paul explores the creative and emotional capabilities of ChatGPT through a personal experiment. He uses one of ChatGPT's music-making features to generate a song based on a simple and heartfelt prompt about parenting and the struggles of feeding a newborn. The resulting AI-generated song, 'Feed Me,' surprises Paul with its emotional depth and resonance, sparking a broader conversation about the changing landscape of creativity and art in the age of artificial intelligence. Paul reflects on the mixed emotions triggered by experiencing an AI produce music that evokes genuine human feelings. While impressed by the quality of the lyrics and the ambiguous, nuanced meaning captured by the AI, he also grapples with existential questions about redundancy, creativity, and the future of human artistic expression. The episode ultimately raises important concerns and excitement about how AI is transforming not just music production, but the very definition of what it means to create art. Listeners are invited to consider their own responses to AI-driven creativity and where the boundary between human and machine artistry might lie in the future. 🎙️ _Hosted by Paul at Talking to AI — where real people, real problems, and real conversations meet artificial intelligence._

19. mar. 202610 min