Refactor to use new Converse API

This commit is contained in:
Aiden Dai
2024-06-04 16:20:25 +08:00
parent 696039053d
commit f0ea117732
3 changed files with 14 additions and 1 deletions

View File

@@ -4,6 +4,13 @@
OpenAI-compatible RESTful APIs for Amazon Bedrock OpenAI-compatible RESTful APIs for Amazon Bedrock
## Breaking Changes
The source code is refactored with the new [Converse API](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html) by bedrock which provides native support with tool calls.
If you are facing any problems, please raise an issue.
## Overview ## Overview
Amazon Bedrock offers a wide range of foundation models (such as Claude 3 Opus/Sonnet/Haiku, Llama 2/3, Mistral/Mixtral, Amazon Bedrock offers a wide range of foundation models (such as Claude 3 Opus/Sonnet/Haiku, Llama 2/3, Mistral/Mixtral,

View File

@@ -4,6 +4,12 @@
使用兼容OpenAI的API访问Amazon Bedrock 使用兼容OpenAI的API访问Amazon Bedrock
## 重大变更
项目源代码已使用Bedrock提供的新 [Converse API](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html) 进行了重构,该API对工具调用提供了原生支持。
如果您遇到任何问题,请提 Github Issue。
## 概述 ## 概述
Amazon Bedrock提供了广泛的基础模型(如Claude 3 Opus/Sonnet/Haiku、Llama 2/3、Mistral/Mixtral等),以及构建生成式AI应用程序的多种功能。更多详细信息,请查看[Amazon Amazon Bedrock提供了广泛的基础模型(如Claude 3 Opus/Sonnet/Haiku、Llama 2/3、Mistral/Mixtral等),以及构建生成式AI应用程序的多种功能。更多详细信息,请查看[Amazon

View File

@@ -4,7 +4,7 @@ WORKDIR /app
COPY ./requirements.txt /app/requirements.txt COPY ./requirements.txt /app/requirements.txt
RUN pip install --no-cache-dir --upgrade -r /app/requirements.txt && pip install --no-cache-dir --upgrade boto3 RUN pip install --no-cache-dir --upgrade -r /app/requirements.txt
COPY ./api /app/api COPY ./api /app/api