llama-cpp

Jan is an open-source desktop AI assistant that runs large language models locally on your computer, providing ChatGPT-like capabilities while maintaining complete privacy and offline functionality.

Ollama is a command-line tool for running large language models locally on desktop computers, supporting popular models like Llama, Gemma, and Mistral with simple installation and management.