Midnight Cleanup: Consolidation & Drift (Karpenter)

Midnight Cleanup: Consolidation & Drift (Karpenter)

SCENARIO: It's 2 AM, traffic is at 5%, but we have 50 nodes running at 10% utilization. Also, some nodes are running an old AMI from 3 months ago. How does Karpenter handle both issues? WHAT THEY'RE TESTING: Consolidation, Drift Detection, Expiration (TTL) THE ANSWER: • CONSOLIDATION (underutilized nodes):  disruption:  consolidationPolicy: WhenEmptyOrUnderutilized  consolidateAfter: 30s  - Karpenter identifies low-utilization nodes  - Drains pods to other nodes, terminates empty ones • DRIFT DETECTION (old AMI):  - Karpenter compares node spec vs current NodeClass  - If AMI changed in NodeClass, node is marked 'drifted'  - Gracefully replaces with new node running correct AMI • EXPIRATION (TTL):  expireAfter: 720h # Force refresh every 30 days → All three are types of DISRUPTION - Karpenter's cleanup mechanism

Unstuck: The Karpenter Lifecycle

SCENARIO: You deploy a new ML training job requiring 8 GPUs, but pods are stuck in Pending. The K8s Scheduler logs show 'no nodes available'. Walk me through exactly what Karpenter does to resolve this, step by step. WHAT THEY'RE TESTING: K8s Scheduler vs Karpenter's role, the 4-step lifecycle THE ANSWER: • WATCH: Karpenter controller watches for pods marked 'unschedulable' by K8s scheduler • EVALUATE: Reads ALL constraints from Pod Spec:  - Resource requests (8 GPUs, memory, CPU)  - nodeSelector, nodeAffinity, tolerations  - Topology spread constraints • PROVISION: Calls AWS EC2 API to launch instance matching ALL requirements  - Selects p3.16xlarge (8 GPUs) in correct zone  - Applies NodePool's taints, labels, kubelet config • RESULT: Node joins cluster, K8s scheduler binds the pod → Key insight: Karpenter provisions, K8s scheduler still does final binding!

Migrate a stateful .NET app from Azure VMs to Azure Container Apps with zero downtime. Handle SQL Server Always On AG failover.

Migrate a stateful .NET app from Azure VMs to Azure Container Apps with zero downtime. Handle SQL Server Always On AG failover. 🎓 Ideal for: Cloud Engineers, DevOps Architects, SREs, Platform Engineers 🌐 For full transcripts, diagrams & PDF downloads, visit: 👉 https://www.DevOpsInterview.Cloud 📥 Download our ebook: 100 Real-World DevOps & Cloud Questions

Design Multi-Tenant Argo CD: SSO, Cluster Sharding & Namespace Isolation

📌 Design multi-tenant Argo CD with SSO, cluster sharding, and namespace isolation for 100+ teams. 🎓 Ideal for: Cloud Engineers, DevOps Architects, SREs, Platform Engineers 🌐 For full transcripts, diagrams & PDF downloads, visit: 👉 www.DevOpsInterview.Cloud 📥 Download our ebook: 100 Real-World DevOps & Cloud Questions

Implement Pod Security Admission for Legacy Apps with NET_RAW Using Kyverno

📌 Implement pod security admission for legacy apps requiring `NET_RAW` capability. Use Kyverno mutation policies. 🎓 Ideal for: Cloud Engineers, DevOps Architects, SREs, Platform Engineers 🌐 For full transcripts, diagrams & PDF downloads, visit: 👉 www.DevOpsInterview.Cloud 📥 Download our ebook: 100 Real-World DevOps & Cloud Questions