Use with LMStudio (Phi-3, LLaMA 3, Falcon, Gemma, GPT-Neo-X)

You can set up LMStudio models as Custom models on TypingMind.com .
LMStudio currently supports:
  • Microsoft's Phi-3
  • Meta's Llama 3
  • Falcon
  • GPT-Neo-X
  • Gemma
  • and more
Here’s how!
Note: This instruction is for the Typing Mind Web version (https://www.typingmind.com). For the macOS version and Setapp version, due to Apple’s security policy, requests to http protocol are blocked. If you want to connect to the macOS app, you can still follow the instructions here, but with one additional step: you need to setup HTTPS for LMStudio. This can be done using various techniques (e.g., using a local HTTPS proxy).

Step 1: Download LMStudio

Go to https://lmstudio.ai/ to download LMStudio for your device.
Image without caption

Step 2: Download the AI model

Search and download the specific AI model you want to use, such as Phi-3-mini-4k.
Image without caption

Step 3: Set up Local Server

  • Go to Local Server
  • From the top drop-down list, choose the model you downloaded in Step 2.
  • Go to theΒ ConfigurationΒ section, enable all options.
  • Click Start Server
Image without caption
You should see a confirmation message once the server starts.
Image without caption

Step 4: Set up LMStudio models on TypingMind

  • Go to Manage Models
  • Add Custom Models
Image without caption

Step 5: Start chatting

Interact with Phi-3 or your chosen AI model on TypingMind!
Image without caption