This desktop app for hosting and running LLMs locally is rough in a few spots, but still useful right out of the box.

Keep a Raspberry Pi AI chatbot responsive by preloading the LLM and offloading with Docker, reducing first reply lag for ...