Jan 16
Loading video player...
In this episode, I’m talking with Vincent Warmerdam about treating LLMs as just another API in your Python app, with clear boundaries, small focused endpoints, and good monitoring. We’ll dig into patterns for wrapping these calls, caching and inspecting responses, and deciding where an LLM API actually earns its keep in your architecture. ▬▬▬▬ About the podcast ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ This video is the uncut, live recording of the Talk Python To Me podcast ( https://talkpython.fm ). We cover Python-focused topics every week and publish the edited and polished version in audio form. Subscribe in your podcast player of choice (100% free) at https://talkpython.fm/subscribe. ▬▬▬▬ Guests ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ Vincent D. Warmerdam ▬▬▬▬ Links and resources from the show ▬▬▬▬▬▬▬▬▬▬▬▬ Vincent on X: https://x.com/fishnets88?featured_on=talkpython Vincent on Mastodon: https://fosstodon.org/@koaning LLM Building Blocks for Python Co-urse: https://training.talkpython.fm/courses/llm-building-blocks-for-python Top Talk Python Episodes of 2024: https://talkpython.fm/blog/posts/top-talk-python-podcast-episodes-of-2024/ LLM Usage - Datasette: https://llm.datasette.io/en/stable/usage.html DiskCache - Disk Backed Cache (Documentation): https://grantjenks.com/docs/diskcache smartfunc - Turn docstrings into LLM-functions: https://github.com/koaning/smartfunc Ollama: https://ollama.com LM Studio - Local AI: https://lmstudio.ai marimo - A Next-Generation Python Notebook: https://marimo.io Pydantic: https://pydantic.dev Instructor - Complex Schemas & Validation (Python): https://python.useinstructor.com/#complex-schemas-validation Diving into PydanticAI with marimo: https://www.youtube.com/watch?v=ujQjqqBka-8 Cline - AI Coding Agent: https://cline.bot OpenRouter - The Unified Interface For LLMs: https://openrouter.ai Leafcloud: https://leaf.cloud OpenAI looks for its "Google Chrome" moment with new Atlas web browser: https://arstechnica.com/ai/2025/10/openais-new-atlas-web-browser-wants-to-let-you-chat-with-a-page/ ▬▬▬▬ Dive deeper ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ Listen to the Talk Python To Me podcast at https://talkpython.fm and explore over 275 hours of Python courses at https://training.talkpython.fm/courses. ▬▬▬▬ Follow us on Social ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ Mastodon: Michael - https://fosstodon.org/@mkennedy & Talk Python - https://fosstodon.org/@talkpython Bluesky: Michael - https://bsky.app/profile/mkennedy.codes & Talk Python - https://bsky.app/profile/talkpython.fm X: Michael - https://x.com/mkennedy & Talk Python - https://x.com/talkpython