macai

Swift powered native macOS client for Ollama, ChatGPT and compatible API-backends

MIT License

Stars
68
Committers
1

macai

macai (macOS AI) is a simple yet powerful native macOS client made to interact with modern AI tools (ChatGPT- and Ollama-compatible API are supported).

Downloads

You can download latest binary, notarized by Apple, on Releases page.

You can also support project on Gumroad.

Build from source

Checkout main branch and open project in Xcode 14.3 or later

Features

  • ChatGPT/Ollama and other compatible API support
  • Customized system messages (instructions) per chat
  • System-defined light/dark theme
  • Backup and restore your chats
  • Customized context size
  • Any LLM with compatible API can be used
  • Formatted code blocks with syntax highlighting
  • Formatted tables with copy as CSV and as JSON functions
  • Formatted equations
  • Data is stored locally using CoreData
  • Streamed responses
  • Automatically generate chat names

Run with ChatGPT

To run macai with ChatGPT, you need to have ChatGPT API token. You can get it here. Add the token to the settings and you are ready to go. Note: by default, gpt-4o model is selected. You can change it in the New Chat settings.

Run with Ollama

Ollama is the open-source back-end for various LLM models. Run with Ollama is very easy:

  1. Install Ollama from the official website
  2. Follow installation guides
  3. After installation, select model (llama3 is recommended) and run ollama using command: ollama run llama3
  4. In macai LLM settings, set ChatGPT/LLM API Url to http://localhost:11434/api/chat:
    CleanShot 2024-04-22 at 17 16 18@2x
  5. In macai New Chat settings, set model to llama3
  6. Changing default instructions is recommended
  7. Test and enjoy!

System requirements

macOS 12.0 and later (both Intel and Apple chips are supported)

Project status

Project is in the active development phase.

Contributions

Contributions are welcomed. Take a look at macai project page and Issues page to see planned features/bug fixes, or create a new one.

Screenshots

Starting screen

Customized system message

An example of custom system message and ChatGPT responses:

Code formatting and syntax highlighting

The syntax of the code provided in ChatGPT response will be highlighted (185 languages supported)

Table formatting

In most cases, tables in ChatGPT repsonses can be formatted as follows:

Equation formatting

Settings

License

MIT

Package Rankings
Top 6.75% on Proxy.golang.org
Related Projects