Refactor to use new Converse API
This commit is contained in:
@@ -4,6 +4,13 @@
|
|||||||
|
|
||||||
OpenAI-compatible RESTful APIs for Amazon Bedrock
|
OpenAI-compatible RESTful APIs for Amazon Bedrock
|
||||||
|
|
||||||
|
## Breaking Changes
|
||||||
|
|
||||||
|
The source code is refactored with the new [Converse API](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html) by bedrock which provides native support with tool calls.
|
||||||
|
|
||||||
|
If you are facing any problems, please raise an issue.
|
||||||
|
|
||||||
|
|
||||||
## Overview
|
## Overview
|
||||||
|
|
||||||
Amazon Bedrock offers a wide range of foundation models (such as Claude 3 Opus/Sonnet/Haiku, Llama 2/3, Mistral/Mixtral,
|
Amazon Bedrock offers a wide range of foundation models (such as Claude 3 Opus/Sonnet/Haiku, Llama 2/3, Mistral/Mixtral,
|
||||||
|
|||||||
@@ -4,6 +4,12 @@
|
|||||||
|
|
||||||
使用兼容OpenAI的API访问Amazon Bedrock
|
使用兼容OpenAI的API访问Amazon Bedrock
|
||||||
|
|
||||||
|
## 重大变更
|
||||||
|
|
||||||
|
项目源代码已使用Bedrock提供的新 [Converse API](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html) 进行了重构,该API对工具调用提供了原生支持。
|
||||||
|
|
||||||
|
如果您遇到任何问题,请提 Github Issue。
|
||||||
|
|
||||||
## 概述
|
## 概述
|
||||||
|
|
||||||
Amazon Bedrock提供了广泛的基础模型(如Claude 3 Opus/Sonnet/Haiku、Llama 2/3、Mistral/Mixtral等),以及构建生成式AI应用程序的多种功能。更多详细信息,请查看[Amazon
|
Amazon Bedrock提供了广泛的基础模型(如Claude 3 Opus/Sonnet/Haiku、Llama 2/3、Mistral/Mixtral等),以及构建生成式AI应用程序的多种功能。更多详细信息,请查看[Amazon
|
||||||
|
|||||||
@@ -4,7 +4,7 @@ WORKDIR /app
|
|||||||
|
|
||||||
COPY ./requirements.txt /app/requirements.txt
|
COPY ./requirements.txt /app/requirements.txt
|
||||||
|
|
||||||
RUN pip install --no-cache-dir --upgrade -r /app/requirements.txt && pip install --no-cache-dir --upgrade boto3
|
RUN pip install --no-cache-dir --upgrade -r /app/requirements.txt
|
||||||
|
|
||||||
COPY ./api /app/api
|
COPY ./api /app/api
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user