Tool Category

Chat Interfaces

Use local and hosted models through a practical conversational interface.

Open source

AnythingLLM

Knowledge & RAG

Mintplex Labs · MIT

A desktop and self-hosted workspace for document chat, RAG, and AI agents.

Desktop / localSelf-hostedmacOSWindows
Best for

Private document question answering

Open source

Jan

Runtimes

Jan HQ · Apache-2.0

An open-source desktop chat application and local API for running models privately on a personal computer.

Desktop / localmacOSWindows
Best for

Open-source desktop local chat

Open source

Khoj

Knowledge & RAG

Khoj AI · AGPL-3.0

A self-hostable personal AI and knowledge assistant with document search, agents, automations, and research workflows.

Desktop / localSelf-hostedmacOSWindows
Best for

A private personal knowledge assistant

Open source

LibreChat

Chat UIs

LibreChat · MIT

A self-hosted multi-provider chat application with agents, files, search, MCP, and model routing.

Self-hostedLinuxDocker
Best for

Self-hosted multi-provider chat

Proprietary

LM Studio

Runtimes

LM Studio · Proprietary

A polished desktop application for discovering, running, and serving local models.

Desktop / localmacOSWindows
Best for

Exploring local models from a desktop UI

Source available

Open WebUI

Chat UIs

Open WebUI · Open WebUI License

A self-hosted chat and knowledge interface for local and cloud model providers.

Desktop / localSelf-hostedmacOSWindows
Best for

Adding a shared UI to Ollama or an API server

Open source

GPT4All

Runtimes

Nomic AI · MIT

A private desktop chat application and Python SDK for running GGUF language models on everyday computers.

Desktop / localSelf-hostedmacOSWindows
Best for

Offline desktop chat on consumer computers

Open source

KoboldCpp

Runtimes

KoboldCpp Project · AGPL-3.0

A compact GGUF runtime and web interface focused on local text generation, roleplay, and story workflows.

Desktop / localSelf-hostedmacOSWindows
Best for

Local creative writing and roleplay

Source available

LobeChat

Chat UIs

LobeHub · LobeHub Community License

A polished chat and agent workspace with provider routing, knowledge bases, plugins, and optional managed cloud.

Desktop / localSelf-hostedWebmacOS
Best for

Polished personal or team AI workspace

Explore other tool categories