Local LLM setup

#ai

Local LLM

  • https://ollama.com/
  • https://anythingllm.com/

Open WebUI

  • https://github.com/open-webui/open-webui
  • https://pahautelman.github.io/pahautelman-blog/tutorials/open-webui-rag/open-webui-rag/
  • https://github.com/pahautelman/open-webui-email-calendar-assistant
  • https://docs.openwebui.com/

Development

  • https://www.continue.dev/

LLM Memory

  • https://github.com/mem0ai/mem0
  • https://github.com/letta-ai/letta

Prompts

  • https://github.com/danielmiessler/fabric
  • https://github.com/x1xhlol/system-prompts-and-models-of-ai-tools/tree/main

Hardware

  • https://docs.nvidia.com/cuda/cuda-installation-guide-linux/#ubuntu-installation

Links

  • [[2025-W30]]