Mar 30
Loading video player...
This video demonstrates how to implement true scale-to-zero capabilities in Kubernetes without relying on specialized serverless platforms like Knative or AWS Lambda. Using standard Kubernetes components—Envoy Gateway, KEDA, Prometheus, and the KEDA HTTP Add-on—the tutorial shows how to build a system that automatically scales applications from zero to multiple replicas based on actual traffic demand, without losing any incoming requests. The demonstration progresses through three stages: starting with a static single-replica deployment, adding Prometheus-based autoscaling that adjusts between one and five replicas based on request rates, and finally achieving complete scale-to-zero functionality. The key innovation is using KEDA's HTTP interceptor to hold requests in memory during cold starts while pods spin up, ensuring zero request loss even when scaling from nothing. The video also covers using Crossplane to provision fully configured clusters with all necessary components pre-installed. While acknowledging trade-offs like cold-start latency and interceptor memory limits, the approach offers significant resource efficiency by keeping idle applications at zero replicas, all while maintaining standard Kubernetes primitives and avoiding vendor lock-in. ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ Sponsor: Kilo Code 🔗 https://kilo.ai ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ #Kubernetes #ScaleToZero #KEDA Consider joining the channel: https://www.youtube.com/c/devopstoolkit/join ▬▬▬▬▬▬ 🔗 Additional Info 🔗 ▬▬▬▬▬▬ ➡ Transcript and commands: https://devopstoolkit.live/app-management/kubernetes-serverless-without-the-vendor-lock-in-heres-how 🔗 Crossplane: https://crossplane.io ▬▬▬▬▬▬ 💰 Sponsorships 💰 ▬▬▬▬▬▬ If you are interested in sponsoring this channel, please visit https://devopstoolkit.live/sponsor for more information. Alternatively, feel free to contact me over Twitter or LinkedIn (see below). ▬▬▬▬▬▬ 👋 Contact me 👋 ▬▬▬▬▬▬ ➡ BlueSky: https://vfarcic.bsky.social ➡ LinkedIn: https://www.linkedin.com/in/viktorfarcic/ ▬▬▬▬▬▬ 🚀 Other Channels 🚀 ▬▬▬▬▬▬ 🎤 Podcast: https://www.devopsparadox.com/ 💬 Live streams: https://www.youtube.com/c/DevOpsParadox ▬▬▬▬▬▬ ⏱ Timecodes ⏱ ▬▬▬▬▬▬ 00:00 Serverless in Kubernetes 01:35 Kilo Code (sponsor) 03:05 Kubernetes Scale-to-Zero Ready Cluster 07:45 From Static Replicas to Scale-to-Zero 16:48 Kubernetes Serverless Pros and Cons