Building a Self-Hosted MLOps Platform with Kubernetes

Description

🔊 Recorded at PyCon DE & PyData 2025, April 24, 2025 https://2025.pycon.de/program/3CYZUH/ 🎓 A practical examination of building and scaling a Kubernetes-based MLOps platform that serves 150+ ML engineers across diverse retail domains. Speakers: Josef Nagelschmidt Description: In this presentation, Josef Nagelschmidt discusses the development and implementation of a self-hosted MLOps platform at Rewe Digital, built on Kubernetes. The talk examines the challenges of managing machine learning applications across diverse retail domains including e-commerce, supply chain, and last-mile delivery. Nagelschmidt explains why the team chose to build their own platform rather than use managed solutions like Google's Vertex AI, highlighting requirements for flexibility, cost-effectiveness, and integration with existing infrastructure. The platform's architecture employs a modular approach with core components including a feature store (implementing Feast), model registry (using MLflow), and compute engine (using Ray). These components are unified through Kubernetes as the control plane, allowing for standardized deployment, networking, and observability. The platform provides lightweight tooling and SDK components rather than heavy abstractions, enabling teams to maintain flexibility while benefiting from reusable patterns. Particular attention is paid to maintaining GitOps principles and ensuring proper versioning of models and features. The implementation demonstrates how open-source tools can be effectively integrated into a production-ready MLOps platform while maintaining the flexibility needed for diverse machine learning applications. ⭐️ About PyCon DE & PyData: The PyCon DE & PyData conference unite the Python, AI, and data science communities, offering a unique platform for collaboration and innovation. The PyCon DE & PyData 2025 conference, provided an exceptional experience, fostering deeper connections within the Python community while showcasing advancements in AI and data science. Attendees enjoyed a diverse and engaging program, solidifying the event as a highlight for Python and AI enthusiasts nationwide. Follow us: • LinkedIn: https://www.linkedin.com/company/28908640/ • X: https://www.x.com/pyconde Links: • Conference website: http://pycon.de • Other sessions: https://2025.pycon.de/talks/ The conference is organized by • Python Softwareverband e.V.: http://pysv.org • NumFOCUS Inc.: http://numfocus.org • Pioneers Hub gemeinnützige GmbH: http://pioneershub.org If you enjoyed this session, please like, comment, and subscribe to our channel for more insightful talks and discussions. Share this video with your network to spread the knowledge! Hashtags: #Python #PyConDE #PyData #OpenSource #AI #DataScience #MachineLearning #SoftwareDevelopment #LLMs #Community Acknowledgements: Special thanks to all the volunteers and sponsors who made this event possible. About: Python Softwareverband e.V.: PySV is a non-profit that promotes the use and development of Python in Germany through events, education, and advocacy, fostering an open Python community. NumFOCUS Inc. supports open-source scientific computing by providing financial and logistical support to key projects like NumPy and Jupyter, promoting sustainable development and collaboration. Pioneers Hub gemeinnützige GmbH: is a non-profit fostering innovation in AI and tech by connecting experts and promoting knowledge exchange through events and collaborative initiatives.