Observability 2.0 - More Than Just Logs, Metrics & Traces

Description

Join us as Neel explores how observability is evolving beyond traditional logs, metrics, and traces into a predictive, AI-powered discipline. Neel walks through the evolution of Observability, demonstrating how OpenTelemetry, machine learning, and LLMs are transforming how we monitor and maintain modern applications. You'll learn about dynamic sampling techniques that reduce costs while maintaining visibility, how ML algorithms detect anomalies before they cause outages, and practical implementations using tools like the OpenTelemetry Collector. This episode covers real-world scenarios from reducing massive log volumes to predicting system failures before they impact customers. Timestamps 0:00 Welcome & Introduction 4:29 Neel's Background & Community Work 5:03 The Evolution of Observability 6:29 The 2 AM Production Incident Scenario 8:13 OpenTelemetry's Role in Modern Observability 12:45 Dynamic Sampling Techniques 18:22 ML & AI in Anomaly Detection 24:16 LLM Observability Explained 28:32 Cost Optimization Strategies 30:04 Context Windows & Token Management 32:00 Self-Healing Systems Discussion 34:15 Edge Cases: When Dynamic Sampling Doesn't Work 36:27 Wrap-up & Resources How to find Neel: https://www.linkedin.com/in/neelcshah/ https://bento.me/neelshah Links from the show: https://neelshah.dev/blogs/observability-2 https://opentelemetry.io/ https://middleware.io/blog/observability-2-0/ __________ DISCLOSURES ❤ This description contains affiliate links that allow you to find the items mentioned in this video and support the channel at no cost to you. vBrownBag is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to www.amazon.com. Thank you for your support! __________ *About #vBrownBag * SUBSCRIBE! https://www.youtube.com/@vbrownbag Socials: LinkedIn: https://www.linkedin.com/company/vbrownbag Bluesky: https://bsky.app/profile/vbrownbag.com Twitter: https://twitter.com/vBrownBag Facebook: https://facebook.com/vBrownBag Apple Podcasts: http://bit.ly/vbrownbagitunes https://vBrownBag.com is a community of people who believe in helping other people. Specifically, we work in IT infrastructure and we help other people in the IT industry to better their careers through education. Our most frequent activity is producing the vBrownBag podcast. vBrownBag also attends global conferences to produce TechTalks and theater sessions. *About vBrownBag Podcasts* The vBrownBag crew host podcasts where community members present on topics that will help others in the community. Some podcast series are aimed at helping people achieve certifications. Other podcasts help community members learn an entirely new subject area like storage, automation, programming, and more! The podcast has been running weekly since 2010. *vBrownBag TechTalks* The vBrownBag crew love IT conferences, the only place where we actually see each other, the awesome people who are our presenters and the community members who follow the podcast. The conferences are also a great place to generate some more community learning content. More about vBrownBag: https://vbrownbag.com/brownbags/what-is-vbrownbag/ Intro music attribution: Artist - MaxKoMusic