From Retrieval to Navigation: The New RAG Paradigm

Description

Teaching LLMs how to manage their own context may be easier than we thought Resources: Video Materials - https://lucek.ai/blogs/llms-out-of-context RAG Playlist - https://www.youtube.com/playlist?list=PL31XFvSmiPKEMco1JXKtIBttlAOOxE8aO Deep Agents Video - https://youtu.be/Ly9UDjiOpxg Context Rot - https://research.trychroma.com/context-rot RLMs Paper - https://arxiv.org/pdf/2512.24601 RLMs Repo - https://github.com/alexzhang13/rlm Positional Encoding Blog - https://huggingface.co/blog/designing-positional-encoding Chapters: 00:00 - Introduction 01:04 - Why Context Engineering 07:29 - What is the Context Window? 10:38 - Positional Encoding 15:11 - Context Rot 20:16 - From Retrieval to Navigation 23:14 - Recursive Language Models 28:27 - RLM Example 31:18 - Discussion #ai #datascience #programming