You can use AWS Bedrock Claude models on TypingMind Custom by adding a Custom Model using the following steps:
Please note that this is only available forΒ TypingMind CustomΒ Admin users for now. We are actively working on updates to make it accessible to all users soon!
1. Create an AWS account
If you do not have an account yet, register for an AWS account here: https://signin.aws.amazon.com/signup?request_type=register
Once you complete signup, move to the next steps.
2. Request Bedrock Claude models
- Search for the "Bedrock" service on the Navigation bar and click on βAmazon Beckrockβ
- Click βGet Startedβ under the Try Bedrock rection
- Select Base Models and hover to the Claude models you want to access β click βModel Accessβ
- Click on βAvailable to requestβ and thereβs a popup that will prompt you to Request model access.
- Click on that and select the Anthropic models you want to access β click βNextβ β click βSubmitβ to submit the model request access.
It might take a few minutes to get approved and access to the chosen models.
3. Create access and secret keys
- Search for βIAMβ service on the search bar
- Click on Users right below the IAM service to navigate to the User Groups page.
- Click on βCreate userβ to create a new user with the Bedrock permissions.
- Enter the username and click βNextβ
- Within the Set Permission options, select βAttach policies directlyβ
- Within the Permission policies, search for Bedrock and select all the polices β Click Next
- Click βCreate userβ to create a new user.
- After completing creating a new user, click on that user to navigate to the new user's details page and generate access and secret keys.
- Click βCreate access keyβ
- Within the Access key best practices and alternatives section, select βApplication running outside AWSβ and click Next
- Click on βCreate access keyβ to have the access key and secret access key.
- Store these access key and secret access key along with the AWS region. Also go back to the Base models page and navigate the Claude model id to copy. We will use this information to create custom model on TypingMind.
4. Create a custom model on TypingMind
Access your Admin Panel, navigate to the Models page, and create a new custom model.
Fill in all required information as follows:
- API Type: Switch to Claude via Bedrock
- Name: give it any name you want, for example, Bedrock Haiku
- Model ID: provide the copied model ID in step 3, for example,
anthropic.claude-3-haiku-20240307-v1:0
- Content length: can set up to 200k tokens
- Click Add Custom Headers and add the following info:
awsAccesskey
:your_access_key
(copied in step 3)awsSecretkey
:your_secret_access_key
(copied in step 3)awsRegion
:your_aws_region
(for example: ap-southeast-2)
- After complete filling all the necessary details, click βTestβ and click βAdd Modelβ