chore(bedrock): add Claude 3.5 Haiku 200k and Cohere Command R+ 128k … #35303
Conversation
github-actions
bot
added
beginning-contributor
| public static readonly ANTHROPIC_CLAUDE_3_5_HAIKU_20241022_V1_0 = new FoundationModelIdentifier('anthropic.claude-3-5-haiku-20241022-v1:0'); | ||
|
|
||
| /** Base model "anthropic.claude-3-5-haiku-20241022-v1:0:200k". */ | ||
| public static readonly ANTHROPIC_CLAUDE_3_5_HAIKU_20241022_V1_0_200K = new FoundationModelIdentifier('anthropic.claude-3-5-haiku-20241022-v1:0:200k'); |
There was a problem hiding this comment.
Can you help me to understand where those model id coming from?
I tried to find it in this table, but both ids don't exist
There was a problem hiding this comment.
In my understanding, this model's ID is 'anthropic.claude-3-5-haiku-20241022-v1:0', and I have confirmed this exists in the documentation table you mentioned. The suffix (:200k) specifies the context window size available for this model.
There was a problem hiding this comment.
Are there any docs or commands that show the existence of model IDs?
I think these are provisioned throughput model IDs, but I couldn't find in docs.
https://docs.aws.amazon.com/bedrock/latest/userguide/pt-supported.html
There was a problem hiding this comment.
Wow, that's exactly the point I was misunderstanding.
I didn't have a proper understanding of the differences between On-Demand and Provisioned Throughput models. Sorry for the confusion, I'll withdraw the PR.
gasolima
added
the
response-requested
github-actions
bot
removed
the
response-requested
aws-cdk-automation
added
the
pr/needs-community-review
|
Comments on closed issues and PRs are hard for our team to see. |
4 participants
Description of changes
ANTHROPIC_CLAUDE_3_5_HAIKU_20241022_V1_0_200Kfor Claude 3.5 Haiku with 200k context windowCOHERE_COMMAND_R_PLUS_V1_0_128Kfor Cohere Command R+ with 128k context windowDescription of how you validated changes
Checklist
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license