Get AI-Ready With Erik: Embedding Freshness

Description

## Summary In this video, I delve into the topic of keeping embeddings fresh in SQL Server databases, a critical aspect often overlooked due to its complexity and lack of straightforward solutions from Microsoft. I explore why regenerating all embeddings can be impractical and discuss more efficient methods like using queue tables and triggers to handle incremental updates. By walking through the setup process and providing examples, including how to create a computed column (despite SQL Server’s current limitations), I aim to equip you with practical strategies to avoid embedding drift and ensure your data remains relevant and accurate. Whether you're dealing with user profiles, content management systems, or any application that relies on embeddings, this video offers valuable insights into maintaining the integrity of your data. ## Topics `SQL Server`, `embeddings`, `freshness`, `database management`, `computed columns`, `triggers`, `queue tables`, `concurrency`, `embedding drift`, `machine learning`, `AI`, `SQL Server 2022`, `data updates`, `incremental updates`, `external services`, `HTTP`, `HTTPS`, `OLama`, `stored procedures`, `cursors`, `internet calls`, `software development`, `hot yoga`, `job search`, `video transcription` ## Chapters - **00:00:00** - Introduction - **00:00:31** - Embedding Freshness Options - **00:01:09** - Microsoft's Approach Critique - **00:02:14** - Table Creation Challenges - **00:03:06** - Queue Table Setup - **00:04:03** - Trigger Implementation - **00:05:30** - Embedding Process Details - **00:08:12** - Preventing Embedding Drift ━━━━━━━━━━━━━━━━━━━━━━━━━━ 📚 TRAINING & COURSES ━━━━━━━━━━━━━━━━━━━━━━━━━━ Get AI-Ready With Erik https://training.erikdarling.com/get-ai-ready-with-erik?coupon=AIREADY SQL Server Performance Engineering Course https://training.erikdarling.com/sql-server-performance-engineering?coupon=ENGINEERING Learn T-SQL with Erik https://training.erikdarling.com/learn-t-sql-with-erik?coupon=ADVANCEDTSQL Everything Bundle: https://training.erikdarling.com/?coupon=SPRINGCLEANING ━━━━━━━━━━━━━━━━━━━━━━━━━━ 🛠️ CONSULTING & SERVICES ━━━━━━━━━━━━━━━━━━━━━━━━━━ Need SQL Server performance help? https://training.erikdarling.com/sqlconsulting ━━━━━━━━━━━━━━━━━━━━━━━━━━ 💬 CONNECT ━━━━━━━━━━━━━━━━━━━━━━━━━━ Ask questions at Office Hours https://erikdarling.com/officehours/ Become a channel member https://www.youtube.com/@ErikDarlingData/join