Omslagafbeelding van de show Practical GCP Podcast by AI

Practical GCP Podcast by AI

Podcast door Richard He

Engels

Technologie en Wetenschap

Tijdelijke aanbieding

2 maanden voor € 1

Daarna € 9,99 / maandElk moment opzegbaar.

  • 20 uur luisterboeken / maand
  • Podcasts die je alleen op Podimo hoort
  • Gratis podcasts
Begin hier

Over Practical GCP Podcast by AI

I run a YouTube channel, Practical GCP (https://www.youtube.com/@practicalgcp2780), where I share practical guides for building and deploying data apps on Google Cloud. Some videos are lengthy, so I thought turning popular ones into AI-generated conversational podcasts could be a fun way to learn, especially on the go. Since it’s AI-created, quality may vary, so use it for inspiration and refer back to the original videos for precise details. Enjoy! 🚀

Alle afleveringen

1 afleveringen

aflevering When Cloud Run Meets DeepSeek: Deploying a Powerful Open-Source LLM with GPU Auto-Scaling artwork

When Cloud Run Meets DeepSeek: Deploying a Powerful Open-Source LLM with GPU Auto-Scaling

Tired of wrestling with complex AI model deployments? In this episode, we dive into a game-changing approach to deploying DeepSeek R1—a ChatGPT-level reasoning model—securely and efficiently using Google Cloud Run with Nvidia L4 GPU support. This setup isn’t just experimental; it’s production-ready, scalable, and cost-optimised. Here’s why this matters: 🔹 Production-Grade Simplicity: Skip the DevOps headache. Learn how to package DeepSeek R1 into a 5GB Docker container with Ollama, deploy via Cloud Run, and handle cold starts in just 4–6 seconds. 🔹 GPU Auto-Scaling: Instances scale dynamically with workload, eliminating idle costs. 🔹 Security & Privacy: Your data stays entirely within your cloud environment—no internet access required. We’ll break down the key insights from the original video, including: ✅ Design & Deployment: Why separate application backends from model APIs and step-by-step packaging using Ollama and Cloud Build. ✅ Real-World Demo: See it in action! ✅ Performance & Scalability: Test cases, optimisation attempts, and outcomes. ✅ Cost Analysis: Is it cheaper than ChatGPT? ✅ Key Benefits: Why this setup is a game-changer for AI deployments. This setup stands out because it: 👉 Scales to Zero: Pay nothing when idle—ideal for internal tools or bursty workloads. 👉 Enterprise-Ready: Perfect for B2B/B2C apps requiring privacy, compliance, and low latency. 👉 Future-Proof: Easily swap DeepSeek R1 for other open-source models without rearchitecting. If you want to dive deeper, check out the original video for more details: https://www.youtube.com/watch?v=7H6fJVf79o0 Who should listen? 💡 Engineers streamlining AI deployments. 💡 Teams building secure, internal LLM tools. 💡 Cloud architects optimising cost-performance trade-offs. Let’s discuss: Have you tried GPU-backed Cloud Run? How are you balancing open-source models with production demands? Share your thoughts! This podcast description was generated by AI based on the original video. For the full experience, including visuals and detailed demonstrations, visit the original video linked above.

23 jan 2025 - 18 min
Meld je aan om te luisteren
Super app. Onthoud waar je bent gebleven en wat je interesses zijn. Heel veel keuze!
Super app. Onthoud waar je bent gebleven en wat je interesses zijn. Heel veel keuze!
Makkelijk in gebruik!
App ziet er mooi uit, navigatie is even wennen maar overzichtelijk.

Kies je abonnement

Meest populair

Tijdelijke aanbieding

Premium

20 uur aan luisterboeken

  • Podcasts die je alleen op Podimo hoort

  • Geen advertenties in Podimo shows

  • Elk moment opzegbaar

2 maanden voor € 1
Daarna € 9,99 / maand

Begin hier

Premium Plus

Onbeperkt luisterboeken

  • Podcasts die je alleen op Podimo hoort

  • Geen advertenties in Podimo shows

  • Elk moment opzegbaar

Probeer 7 dagen gratis
Daarna € 13,99 / maand

Probeer gratis

Alleen bij Podimo

Populaire luisterboeken

Veelgestelde vragen

Meer vragen & antwoorden
Begin hier

2 maanden voor € 1. Daarna € 9,99 / maand. Elk moment opzegbaar.