
Engageware: The Future of Agentic AI in Financial Services | Money20/20 USA
Financial IT
🎥 Recorded live at the MLOps World | GenAI Summit 2025 — Austin, TX (October 9, 2025) Session Title: A Modular Framework for Building Agentic Workforces at Marriott International Speaker: Nitin Kumar, Director of Data Science, Marriott International Abstract: As large language models (LLMs) transform knowledge work—from content creation to multilingual communication—organizations face new challenges in maintaining trust, governance, and quality control at scale. In this lightning talk, Nitin Kumar from Marriott International presents a modular framework for building agentic workforces—semi-autonomous AI systems designed to collaborate with human oversight. This approach blends LLM-driven generation, automated evaluation (LLM-as-a-judge), and human-in-the-loop (HitL) verification to ensure every output meets standards for accuracy, tone, and contextual fit. Nitin will walk through Marriott’s design patterns for routing uncertain cases to human reviewers, defining escalation triggers, layering automated evaluation rubrics, and closing feedback loops for continuous improvement. What you’ll learn: • How to design scalable, semi-autonomous AI workflows that combine automation with human oversight • How to implement confidence-based routing and escalation triggers in production • How to integrate LLM-as-a-judge systems for real-time evaluation and quality control • Practical techniques for balancing speed, accuracy, and accountability in generative AI workflows • Why agentic workforces are the next step toward responsible and reliable AI adoption in enterprise settings 📍 Recorded: October 9, 2025 — Lightning Talk, MLOps World | GenAI Summit 2025, Austin, TX 🔗 Learn more: https://mlopsworld.com #MLOpsWorld #GenAISummit #NitinKumar #MarriottInternational #AgenticAI #LLM #AIWorkforce #AITrust #AIEthics #MLOps #LLMOps #HumanInTheLoop #AIinProduction #AICommunity #GenAI