Cover image of show Hidden State

Hidden State

Podcast by Hidden State

English

Culture & leisure

Limited Offer

2 months for 19 kr.

Then 99 kr. / monthCancel anytime.

  • 20 hours of audiobooks / month
  • Podcasts only on Podimo
  • All free podcasts
Get Started

About Hidden State

Hidden State is the podcast where books reveal their secrets. Each episode, we dive deep into the pages of book — and explore the layers that live beneath the surface. From hidden layers we unpack the ideas that linger long after the last chapter. Whether you’re a curious reader, or just someone who craves a deeper look into the written word, Hidden State invites you to read between the lines, narrated by AI

All episodes

4 episodes

episode Situational Awareness: Counting Orders of Magnitude in AI Progress artwork

Situational Awareness: Counting Orders of Magnitude in AI Progress

The source, titled "Situational Awareness: The Decade Ahead," by Leopold Aschenbrenner, discusses the author's perspective on the rapid advancements and potential future of artificial intelligence, dedicating the work to Ilya Sutskever. Aschenbrenner argues that a small group of people, primarily within AI labs, possess a unique situational awareness of these developments, having correctly predicted recent progress based on trendlines in compute and algorithmic efficiencies. The text projects a significant leap by 2027, potentially leading to AGI (Artificial General Intelligence) equivalent to a smart high-schooler, and the author further posits that AGI could quickly lead to superintelligence through accelerated AI research, compressing years of progress into months. The author identifies major challenges and potential pitfalls, including the immense capital buildout required for compute clusters, the critical need to secure AI secrets and weights from state actors like the CCP, the complex technical problem of superalignment to ensure AI systems are controllable, and the geopolitical race for dominance with authoritarian powers. Ultimately, Aschenbrenner suggests that the development of superintelligence will necessitate a government-led project, akin to the Manhattan Project, due to the national security implications and the scale of the required resources and security measures. https://situational-awareness.ai

1 May 2025 - 14 min
episode Build a Large Language Model (From Scratch) artwork

Build a Large Language Model (From Scratch)

This compilation of excerpts focuses on the practical implementation of large language models (LLMs), particularly those resembling the GPT architecture, from the foundational concepts upwards using PyTorch. It explains key components such as tokenization, embeddings, attention mechanisms, and transformer blocks, detailing how they contribute to building these models. The text also covers crucial processes for LLM development including pretraining and fine-tuning for various tasks, like text classification and instruction following, highlighting practical aspects such as handling datasets, managing hardware limitations, and utilizing pre-trained weights. Furthermore, it introduces methods for evaluating model performance and generating text, discussing techniques like greedy decoding and probabilistic sampling, and provides insights into advanced training techniques like parameter-efficient fine-tuning. Build a Large Language Model (From Scratch) -https://amzn.to/42uzzZR

27 Apr 2025 - 22 min
episode AI Engineering with Foundation Models artwork

AI Engineering with Foundation Models

This collection of excerpts offers a detailed exploration of AI Engineering, focusing on the practical aspects of building and deploying applications using foundation models. It discusses the evolution of AI models, from traditional ML to large language and multimodal models, outlining their capabilities and the challenges they present. The text covers key areas like evaluation methodologies, different model architectures and scaling factors, prompt engineering best practices for guiding model behavior, and advanced techniques such as Retrieval Augmented Generation (RAG) and the use of agents. Furthermore, it addresses crucial considerations for production systems, including finetuning models, dataset engineering (curation, synthesis, and processing), inference optimization for efficiency, and designing robust AI engineering architectures that incorporate feedback mechanisms. AI Engineering with Foundation Models - https://amzn.to/3YMqoS9

24 Apr 2025 - 23 min
episode Understanding Deep Learning artwork

Understanding Deep Learning

This comprehensive textbook, "Understanding Deep Learning" by Simon J.D. Prince aims to provide newcomers with a strong conceptual foundation of deep learning principles without heavy mathematical proofs or extensive coding. It systematically introduces core concepts, starting with supervised learning and shallow neural networks, and then progresses to more advanced architectures like convolutional networks, residual networks, and transformers. The book also explores key aspects of deep learning algorithms, including loss functions, optimization, regularization, and unsupervised and reinforcement learning techniques. Furthermore, it addresses important ethical considerations and potential societal impacts of this rapidly evolving field. Understanding Deep Learning - https://amzn.to/3YEVZ8g [https://amzn.to/3YEVZ8g]

21 Apr 2025 - 37 min
Sign up to listen
En fantastisk app med et enormt stort udvalg af spændende podcasts. Podimo formår virkelig at lave godt indhold, der takler de lidt mere svære emner. At der så også er lydbøger oveni til en billig pris, gør at det er blevet min favorit app.
En fantastisk app med et enormt stort udvalg af spændende podcasts. Podimo formår virkelig at lave godt indhold, der takler de lidt mere svære emner. At der så også er lydbøger oveni til en billig pris, gør at det er blevet min favorit app.
Rigtig god tjeneste med gode eksklusive podcasts og derudover et kæmpe udvalg af podcasts og lydbøger. Kan varmt anbefales, om ikke andet så udelukkende pga Dårligdommerne, Klovn podcast, Hakkedrengene og Han duo 😁 👍
Podimo er blevet uundværlig! Til lange bilture, hverdagen, rengøringen og i det hele taget, når man trænger til lidt adspredelse.

Choose your subscription

Most popular

Limited Offer

Premium

20 hours of audiobooks

  • Podcasts only on Podimo

  • No ads in Podimo shows

  • Cancel anytime

2 months for 19 kr.
Then 99 kr. / month

Get Started

Premium Plus

Unlimited audiobooks

  • Podcasts only on Podimo

  • No ads in Podimo shows

  • Cancel anytime

Start 7 days free trial
Then 129 kr. / month

Start for free

Only on Podimo

Popular audiobooks

Get Started

2 months for 19 kr. Then 99 kr. / month. Cancel anytime.