logo

Use AWS Bedrock Anthropic

You can use AWS Bedrock Claude models on TypingMind Custom by adding a Custom Model using the following steps:
πŸ“Œ
Please note that this is only available forΒ TypingMind CustomΒ Admin users for now. We are actively working on updates to make it accessible to all users soon!

1. Create an AWS account

If you do not have an account yet, register for an AWS account here: https://signin.aws.amazon.com/signup?request_type=register
Image without caption
Once you complete signup, move to the next steps.

2. Request Bedrock Claude models

  • Search for the "Bedrock" service on the Navigation bar and click on β€œAmazon Beckrock”
Image without caption
  • Click β€œGet Started” under the Try Bedrock rection
Image without caption
  • Select Base Models and hover to the Claude models you want to access β†’ click β€œModel Access”
Image without caption
  • Click on β€œAvailable to request” and there’s a popup that will prompt you to Request model access.
Image without caption
  • Click on that and select the Anthropic models you want to access β†’ click β€œNext” β†’ click β€œSubmit” to submit the model request access.
    • It might take a few minutes to get approved and access to the chosen models.
Image without caption

3. Create access and secret keys

  • Search for β€œIAM” service on the search bar
  • Click on Users right below the IAM service to navigate to the User Groups page.
Image without caption
  • Click on β€œCreate user” to create a new user with the Bedrock permissions.
Image without caption
  • Enter the username and click β€œNext”
Image without caption
  • Within the Set Permission options, select β€œAttach policies directly”
  • Within the Permission policies, search for Bedrock and select all the polices β†’ Click Next
Image without caption
Image without caption
  • Click β€œCreate user” to create a new user.
  • After completing creating a new user, click on that user to navigate to the new user's details page and generate access and secret keys.
Image without caption
  • Click β€œCreate access key”
Image without caption
  • Within the Access key best practices and alternatives section, select β€œApplication running outside AWS” and click Next
Image without caption
  • Click on β€œCreate access key” to have the access key and secret access key.
Image without caption
  • Store these access key and secret access key along with the AWS region. Also go back to the Base models page and navigate the Claude model id to copy. We will use this information to create custom model on TypingMind.
Image without caption

4. Create a custom model on TypingMind

Access your Admin Panel, navigate to the Models page, and create a new custom model.
Fill in all required information as follows:
  • API Type: Switch to Claude via Bedrock
  • Name: give it any name you want, for example, Bedrock Haiku
  • Model ID: provide the copied model ID in step 3, for example, anthropic.claude-3-haiku-20240307-v1:0
  • Content length: can set up to 200k tokens
  • Click Add Custom Headers and add the following info:
    • awsAccesskey : your_access_key (copied in step 3)
    • awsSecretkey : your_secret_access_key (copied in step 3)
    • awsRegion : your_aws_region (for example: ap-southeast-2)
Image without caption
Image without caption
  • After complete filling all the necessary details, click β€œTest” and click β€œAdd Model”

5. Chat with the new model

Image without caption