Skip to main content

Quick start with AWS Bedrock

Recommendation

We recommend using Anthropic Claude models on Bedrock for strong reasoning and tool use.

Prerequisites​

  • An AWS account with Bedrock enabled in your region
  • Access to the models you plan to use (e.g., Anthropic Claude) granted in the Bedrock console
  • An AWS Bedrock API key AWS Bedrock API key You could copy the API key from the console. We recommend using the long-term API key with longer expiration date, so you don't have to rotate the key too often.

Steps (Quick setup)​

1. During onboarding, select "Quick setup" and then "AWS Bedrock".​

AWS Bedrock onboarding

2. Enter your region and AWS Bedrock API key.​

AWS Bedrock region and API key

3. Select a embedding model.​

Now, let's go to the AWS Bedrock console to select a embedding model.

Visit the AWS Bedrock console -> "Model Catalog".​

AWS Bedrock console AWS Bedrock model catalog

AWS Bedrock search bar AWS Bedrock search for Titan

Click into the "Titan Text Embedding V2" model. Copy the model ID.​

AWS Bedrock Titan Text Embedding V2 model ID

Back to Wren AI, enter the model ID.​

At the "Embedding model" section, in the input, click "Add embedding model".

Add embedding model

Then, at the form, fill in the model ID you copied from the AWS Bedrock console.

Add embedding model form

The configuration is already filled in for you. Click "Add embedding model".

After that, click "Test connection" to verify the embedding model is working.

Test connection

4. Select a LLM model.​

Now, we're adding two LLM models to Wren AI - Claude 4 Sonnet and Claude 3.5 Haiku. Let's go to the AWS Bedrock console to copy the "Inference Profile ID" for each model.

Visit the AWS Bedrock console -> "Cross-region inference".​

AWS Bedrock cross-region inference

AWS Bedrock search for Sonnet 4

Find the "Claude 4 Sonnet" model. Copy the "Inference Profile ID".​

AWS Bedrock Claude 4 Sonnet Inference Profile ID

Back to Wren AI, click "Add model" and paste the "Inference Profile ID".​

Add LLM model form

AWS Bedrock search for Haiku 3.5

Find the "Claude 3.5 Haiku" model. Copy the "Inference Profile ID".​

AWS Bedrock Claude 3.5 Haiku Inference Profile ID

Back to Wren AI, click "Add model" and paste the "Inference Profile ID".

5. Assign the models to pipelines.​

Now, we're assigning the models to pipelines.

  • For pipeline that requires "Advanced capabilities", we recommend assigning the "Claude 4 Sonnet" model.
  • Others, we could assign the "Claude 3.5 Haiku" model.