Programming Throwdown

185: Workflow Orchestrators

1 h 32 min · 4 nov 20251 h 32 min
aflevering 185: Workflow Orchestrators cover

Beschrijving

Intro topic: Asymmetric Returns News/Links: * NanoChat by Andrej Karpathy * https://github.com/karpathy/nanochat [https://github.com/karpathy/nanochat] * Pydantic AI * https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/ [https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/] * 1000th Starlink this year * https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/ [https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/] * ChatGPT Apps SDK * https://openai.com/index/introducing-apps-in-chatgpt/ [https://openai.com/index/introducing-apps-in-chatgpt/] Book of the Show * Patrick * The Will of the Many by James Islington * https://amzn.to/43IfU8Q [https://amzn.to/43IfU8Q] * Jason * Interview with DHH (Founder of Ruby on Rails) * https://www.youtube.com/watch?v=vagyIcmIGOQ [https://www.youtube.com/watch?v=vagyIcmIGOQ] Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h [https://www.patreon.com/programmingthrowdown?ty=h] Tool of the Show * Patrick * Factorio * https://www.factorio.com/ [https://www.factorio.com/]  * Jason * nip.io [http://nip.io]  Topic: Workflow Orchestrators * Why * Batch jobs (embarrassingly parallel) * Long-running tasks (e.g. transcoding video) * Checkpointing/resuming * How * Message Queues * Containerization * Worker Pools & Autoscaling * History & Backfill * Steps to run workflows: * Containerize the workflow definition and send to the cloud * Containerize all the individual tasks * Submit job(s) * Examples * Airflow * Legacy but dominant * Dagster * Great UX for python developers * Temporal: https://temporal.io/ [https://temporal.io/] * The new hotness * Ray * Low-level but very powerful * Kubeflow * Designed for ML workflows, integrated dashboard ★ Support this podcast on Patreon ★ [https://www.patreon.com/programmingthrowdown]

Reacties

0

Wees de eerste die een reactie plaatst

Meld je nu aan en word lid van de Programming Throwdown community!

Probeer gratis

Probeer 7 dagen gratis

€ 9,99 / maand na proefperiode. · Elk moment opzegbaar.

  • Podcasts die je alleen op Podimo hoort
  • 20 uur luisterboeken / maand
  • Gratis podcasts
Probeer gratis

Alle afleveringen

188 afleveringen

aflevering 187: Agentic Coding artwork

187: Agentic Coding

187: Agentic Coding Intro topic: Bad equity vesting schedules News/Links: * Artemis II * https://www.nasa.gov/news-release/nasa-welcomes-record-setting-artemis-ii-moonfarers-back-to-earth/ [https://www.nasa.gov/news-release/nasa-welcomes-record-setting-artemis-ii-moonfarers-back-to-earth/] * Gemma 4 * https://blog.google/innovation-and-ai/technology/developers-tools/gemma-4/ [https://blog.google/innovation-and-ai/technology/developers-tools/gemma-4/] * Hatetris * https://qntm.org/files/hatetris/hatetris.html [https://qntm.org/files/hatetris/hatetris.html] * Dripwarts: School of Drip * https://www.youtube.com/watch?v=MnHjz8jvWFk [https://www.youtube.com/watch?v=MnHjz8jvWFk]  Book of the Show * Patrick * Project Hail Mary * https://amzn.to/4cQdxVa [https://amzn.to/4cQdxVa] Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h [https://www.patreon.com/programmingthrowdown?ty=h] Tool of the Show * Jason * FF6 T-Edition * https://www.romhacking.net/hacks/6339/ [https://www.romhacking.net/hacks/6339/] Topic: Agentic Coding * Progression * Better Code Completion * Intellisense * Copilot * Cowriting  * Cursor * Roo Code  * Longer Horizon * Claude Code * Codex * Gemini CLI * Swarm * Guidelines * Git * Planning * Task decomposition * AGENTS.md * Adjusting vs Restarting * Skepticism * Future of software engineering?

2 mei 20261 h 38 min
aflevering 186: Becoming a Manager artwork

186: Becoming a Manager

186: Becoming a Manager Intro topic: plastic welding kits News/Links: * Parse.bot, turn any website into an API * https://www.parse.bot/ [https://www.parse.bot/] * Gemini 3 * https://blog.google/products/gemini/gemini-3/ [https://blog.google/products/gemini/gemini-3/] * Depth Anything 3 * https://github.com/ByteDance-Seed/Depth-Anything-3 [https://github.com/ByteDance-Seed/Depth-Anything-3] * Wan 2.2 (run on runpod) * https://www.runpod.io/ [https://www.runpod.io/] Book of the Show * Patrick * The Thinking Game (DeepMind documentary) * https://www.youtube.com/watch?v=d95J8yzvjbQ [https://www.youtube.com/watch?v=d95J8yzvjbQ] * Jason * Plato: The Republic * https://www.gutenberg.org/ebooks/1497 [https://www.gutenberg.org/ebooks/1497] Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h [https://www.patreon.com/programmingthrowdown?ty=h] Tool of the Show * Patrick * Core Keeper * Pc/Switch/Xbox/Playstation  * Jason * Workers & Resources: Soviet Republic * PC Topic: Becoming a Manager * What is a Manager * Opportunity * Results + Retention * Sizing * Hiring * Philosophy * Interviews * Downsizing * How to Manage * Company Goals / OKRs * Breaking down & claiming company goals. * Balancing inspirational & practical goals * Coaching * One-on-ones * Career planning * Performance  * Motivation * Performance Management Review * Compensation * Choosing to become a manager * Balancing personal and company incentives * Why Manage * Mentorship * Build relationships * Why to not manage * Less time for your original joy (coding) * Less technical influence * More uncertainty and less closure * How to transition back to Engineer * Take the time/energy to get ramped up * Act as an advisor to your manager ★ Support this podcast on Patreon ★ [https://www.patreon.com/programmingthrowdown]

3 feb 20261 h 27 min
aflevering 185: Workflow Orchestrators artwork

185: Workflow Orchestrators

Intro topic: Asymmetric Returns News/Links: * NanoChat by Andrej Karpathy * https://github.com/karpathy/nanochat [https://github.com/karpathy/nanochat] * Pydantic AI * https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/ [https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/] * 1000th Starlink this year * https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/ [https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/] * ChatGPT Apps SDK * https://openai.com/index/introducing-apps-in-chatgpt/ [https://openai.com/index/introducing-apps-in-chatgpt/] Book of the Show * Patrick * The Will of the Many by James Islington * https://amzn.to/43IfU8Q [https://amzn.to/43IfU8Q] * Jason * Interview with DHH (Founder of Ruby on Rails) * https://www.youtube.com/watch?v=vagyIcmIGOQ [https://www.youtube.com/watch?v=vagyIcmIGOQ] Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h [https://www.patreon.com/programmingthrowdown?ty=h] Tool of the Show * Patrick * Factorio * https://www.factorio.com/ [https://www.factorio.com/]  * Jason * nip.io [http://nip.io]  Topic: Workflow Orchestrators * Why * Batch jobs (embarrassingly parallel) * Long-running tasks (e.g. transcoding video) * Checkpointing/resuming * How * Message Queues * Containerization * Worker Pools & Autoscaling * History & Backfill * Steps to run workflows: * Containerize the workflow definition and send to the cloud * Containerize all the individual tasks * Submit job(s) * Examples * Airflow * Legacy but dominant * Dagster * Great UX for python developers * Temporal: https://temporal.io/ [https://temporal.io/] * The new hotness * Ray * Low-level but very powerful * Kubeflow * Designed for ML workflows, integrated dashboard ★ Support this podcast on Patreon ★ [https://www.patreon.com/programmingthrowdown]

4 nov 20251 h 32 min
aflevering 184: Asynchronous Programming artwork

184: Asynchronous Programming

184: Asynchronous Programming Intro topic: AI Scams News/Links: * Coding Adventure: Ray-Tracing Glass and Caustics (Sebastian Lague) * https://www.youtube.com/watch?v=wA1KVZ1eOuA [https://www.youtube.com/watch?v=wA1KVZ1eOuA] * Boson AI announces Higgs Audio V2 * https://www.boson.ai/technologies/voice [https://www.boson.ai/technologies/voice]  * The Misconception that Almost Stopped AI [How Models Learn Part 1] (Welch Labs) * https://www.youtube.com/watch?v=NrO20Jb-hy0 [https://www.youtube.com/watch?v=NrO20Jb-hy0] * A mind-bending conversation with Peter Thiel * https://www.nytimes.com/2025/07/11/podcasts/interesting-times-a-mind-bending-conversation-with-peter-thiel.html [https://www.nytimes.com/2025/07/11/podcasts/interesting-times-a-mind-bending-conversation-with-peter-thiel.html] Book of the Show * Patrick * The Hobbit (JRR Tolkien) * https://amzn.to/4mevuzE [https://amzn.to/4mevuzE] * Jason * NYT Word Games Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h [https://www.patreon.com/programmingthrowdown?ty=h] Tool of the Show * Patrick * Escape Academy * https://escapeacademygame.com/en [https://escapeacademygame.com/en] * Jason * Multi-modal LLMs to make calendar meetings * www.chatgpt.com [http://www.chatgpt.com] Topic: Asynchronous Computing * What/Why * Multi-threading in between the lines * Many of the benefits of multiprocessing without the overhead/complexity * How * Coroutines * Thread-Local Memory * Blocking vs Non-Blocking operations * Blocking: arithmetic * Non-Blocking: Reading from the network card into thread-local memory * Interpreter locking * Typescript: Single threaded * Python: GIL * Implementations * Polling (not-Asynchronous) * Callbacks (interrupts) * Multithreading (with queues/message passing) * Promise/Futures * Async/Await  ★ Support this podcast on Patreon ★ [https://www.patreon.com/programmingthrowdown]

23 sep 20251 h 30 min