We will expand this page with reports on how well Apertus works with the following software:

• Ollama: run Llama 2, Code Llama, and other models locally
• Jan.ai: an open source alternative to ChatGPT that runs 100% offline on your computer.
• GPT4All: A free-to-use, locally running, privacy-aware chatbot. No GPU or internet is required.
• LM Studio: Discover, download, and run local LLMs.
• PowerInfer: a high-speed inference engine for deploying LLMs locally.
• llama.cpp guide: Running LLMs locally, on any hardware, from scratch.

Feel free to add your own! See also:

• AlternativeTo: Open source LLMs
• https://github.com/abordage/awesome-ai
• https://github.com/filipecalegario/awesome-generative-ai