Documents
Best Local LLMs for Summarization
Qwen 2.5 14B is the summarization sweet spot — strong instruction following, 128K context for 200-page docs, fits on 16GB VRAM. Model picks by use case, quality ratings, chunking strategies, and prompting tips.
AnythingLLM Setup Guide: Chat With Your Documents Locally
Upload PDFs, paste URLs, and chat with your files — no coding, no cloud. AnythingLLM connects to Ollama in 5 minutes with point-and-click RAG on 54K+ GitHub stars.
Local RAG: Search Your Documents with a Private AI
Search your private PDFs, notes, and code with a local LLM—no cloud, no API calls. 3 setup methods from zero-config Open WebUI to 30 lines of Python with ChromaDB.