Building Cloud Native Agentic Workflows on Kubernetes for Preven... Benjamin Consolvo & Daron Yöndem

Description

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon events in Amsterdam, The Netherlands (23-26 March, 2026). Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io Building Cloud Native Agentic Workflows on Kubernetes for Preventative Healthcare - Benjamin Consolvo, AMD & Daron Yöndem, AWS Modern preventative-care programs need to reach thousands of patients without drowning clinicians in manual outreach. In this session we show how an open-source, cloud-native stack (including Kubernetes, APISIX, and Prometheus), and the AutoGen multi-agent framework, automates the entire loop: (1) defining U.S. Preventive Services Task Force screening criteria, (2) filtering patient records, and (3) generating personalized emails via OSS LLMs (Llama 3 & DeepSeek-R1) served behind an OpenAI-compatible API on K8s-native AI accelerators. We’ll dissect the YAML and Helm chart flows that keep model endpoints, agents, and the Streamlit front end deployed. Attendees will learn how to: • Build the model inference endpoint orchestration layers with K8s and Helm charts; • Manage API traffic and authentication with APISIX (built on NGINX and etcd); • Stitch agents together with async Python; and • Oversee monitoring and observability with Prometheus and Grafana.