Demo: Open-Source Ollama-Powered LLM Chat App with FastAPI, Keycloak, and MongoDB

Description

This open-source project is a large language model (LLM) chat application powered by Ollama. You can run your favorite Ollama model with a friendly chat interface or deploy it for team or organizational use, enabling a private, secure, and customizable AI assistant environment within your infrastructure. All's license free. It features a Gradio Web UI for user interaction and a FastAPI backend that handles chat requests, model responses, and system orchestration. The backend is secured with Keycloak OAuth2, ensuring authenticated access and role-based authorization for users. Chat history is stored in MongoDB for fast, scalable storage. Github: https://github.com/panharithan/fastapi-keycloak-for-llm