This desktop app for hosting and running LLMs locally is rough in a few spots, but still useful right out of the box.
Your local LLM is great, but it'll never compare to a cloud model.