Skip to main content

​
Overview

Typing Mind allows you to connect the app with any local model you want.
Local Ai
Requirement:
  • The model must be served via an OpenAI-compatible API endpoint.
  • You must have some relevant technical skills to setup a custom model on your own server/endpoint.
Below is a short instruction on how to setup Typing Mind with a popular local AI setup using the open-source project LocalAI.

​
Setup LocalAI on your device

👉 If you already have another setup for the local AI model endpoint, you can skip this step.
Go to https://github.com/go-skynet/LocalAI and follow their instruction to run a model on your device. For example, here is the command to setup LocalAI with Docker:
💡 Note that we added the --cors true parameter to the command to make sure the local server is accessible from the browser. Typing Mind will send requests to the local model directly from the browser.
If you’re doing it correctly, you should see a message like this: Untitled 1 1 Now you can go to http://localhost:8080/v1/models and confirm that the model is ready: Untitled 2 2

​
Setup Custom Model on TypingMind

Open TypingMind → Models → Add Custom Model:
Local Ai
Enter all the details, then click “Test” to check if your custom model is working correctly.

​
Chat with the new Custom Model

Once the model is tested and added successfully, you can select the custom model and chat with it normally. Untitled 6