Add support of encoded image url

This commit is contained in:
Aiden Dai
2024-04-09 20:43:29 +08:00
parent 1888fa1c98
commit 81716238ec
3 changed files with 80 additions and 6 deletions

View File

@@ -94,7 +94,6 @@ print(doc_result[0][:5])
**Important Notice**: Please carefully review the following points before using this proxy API for Multimodal.
1. This API is only supported by Claude 3 model.
2. You should ensure the image url can be publicly accessible in the Lambda/Fargate.
**Example Request**
@@ -124,6 +123,35 @@ curl $OPENAI_BASE_URL/chat/completions \
}'
```
If you need to use this API with non-public images, you can do base64 the image first and pass the encoded string.
Replace `image/jpeg` with the actual content type. Currently, Only 'image/jpeg', 'image/png', 'image/gif' or 'image/webp' is supported.
```bash
curl $OPENAI_BASE_URL/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $OPENAI_API_KEY" \
-d '{
"model": "gpt-3.5-turbo",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "please identify and count all the objects in this images, list all the names"
},
{
"type": "image_url",
"image_url": {
"url": "data:image/jpeg;base64,<your image data>"
}
}
]
}
]
}'
```
**Example Response**
```json

View File

@@ -93,7 +93,6 @@ print(doc_result[0][:5])
**重要**:在使用此代理API进行多模态处理之前,请仔细阅读以下几点:
1. 此API 仅支持Claude 3模型。
2. 您应确保 Lambda/Fargate 可以公开访问该图片URL。
**Request 示例**
@@ -123,6 +122,35 @@ curl $OPENAI_BASE_URL/chat/completions \
}'
```
如果您需要使用此API处理非公开图像,您可以先对图像进行base64编码,然后传递编码后的字符串。
将"image/jpeg"替换为实际的内容类型(content type)。目前仅支持"image/jpeg"、"image/png"、"image/gif"或"image/webp"。
```bash
curl $OPENAI_BASE_URL/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $OPENAI_API_KEY" \
-d '{
"model": "gpt-3.5-turbo",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "please identify and count all the objects in this images, list all the names"
},
{
"type": "image_url",
"image_url": {
"url": "data:image/jpeg;base64,<your image data>"
}
}
]
}
]
}'
```
**Response 示例**
```json