Commit Graph
69 Commits
Author SHA1 Message Date
heisenbergye 3f1b56a526 feat: support Claude 4 Interleaved thinking (beta) (#164) 2025-07-21 16:44:21 +08:00
Mengxin Zhu 76a3614f17 fix: properly handle tool_use messages in conversation 2025-06-30 00:14:26 +08:00
Gagan MandMengxin Zhu 01836087b1 feat: add support to include application inference profiles as models (#131)
---------

Co-authored-by: Mengxin Zhu <843303+zxkane@users.noreply.github.com>
2025-06-23 22:49:27 +08:00
dependabot[bot] dd191d7cd9 Bump requests from 2.32.3 to 2.32.4 in /src (#151)
Bumps [requests](https://github.com/psf/requests) from 2.32.3 to 2.32.4.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.32.3...v2.32.4)

---
updated-dependencies:
- dependency-name: requests
  dependency-version: 2.32.4
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-06-20 17:50:19 +08:00
Zack Elias 844efec086 add titan G1 embeddings (#152) 2025-06-17 11:09:22 +08:00
UniMa007 aed57307bc Add Titan Embeddings G2 (#94) 2025-05-27 21:52:15 +08:00
Aiden Dai 4e8a913e43 fix empty content issue 2025-04-20 09:21:47 +08:00
Aiden Dai b27e83624f fix typo 2025-03-26 13:10:07 +08:00
Aiden Dai c98e123c8f optimize error response in streaming 2025-03-26 11:32:39 +08:00
Aiden Dai 4f1a75b49f fix potential process stuck issue 2025-03-22 18:39:08 +08:00
Aiden Dai 0ead770069 performance improvement 2025-03-13 18:24:08 +08:00
Aiden Dai fa14ae8c05 apply ruff linter 2025-03-13 14:24:41 +08:00
Aiden Dai f21b9a2e84 apply ruff linter 2025-03-13 13:50:57 +08:00
Aiden Dai 33e8fcfd3b fix potential bad request issue 2025-03-13 07:16:42 +08:00
Zhongsheng Ji fcfebf9d9d feat: Response 429 if ThrottlingException (#91) 2025-03-10 09:01:33 +08:00
Aiden Dai a46e329c97 Support of reasoning 2025-02-26 12:25:38 +08:00
Omri Shaiko 54f4a2b017 Fix issue with toolResult error with Cursor. Use default DEFAULT_MODEL in ChatRequest (#110) 2025-02-26 10:43:44 +08:00
Aiden Dai 3ce47ff278 Partial support of reasoning 2025-02-25 16:23:06 +08:00
Aiden Dai c39f6bc942 Use secrets manager for api key 2025-02-10 15:25:12 +08:00
yytdfc 093c6fa586 add stop parameter (#86) 2024-12-31 11:15:24 +08:00
Aiden Dai b2c187c716 Increase connect timeout 2024-12-19 16:45:18 +08:00
Aiden Dai 51bc727b38 Use readme 2024-12-16 17:11:54 +08:00
Aiden Dai 29621ae59c Automatically detect model list 2024-12-16 16:15:09 +08:00
Aiden Dai d4938a0af2 Automatically detect model list 2024-12-16 16:01:59 +08:00
Attila Szucs cb38d328aa Add environment variable for PORT (#47)
* Customizable port

* Fix CMD
2024-12-16 10:00:17 +08:00
Fabio NonatoandFabio Nonato 4fc0d3bc94 Image error fix (#80)
---------

Co-authored-by: Fabio Nonato <fnp@amazon.com>
2024-12-11 11:26:51 +08:00
Hans Knecht 241d5c0f3e feat: allow the use of an ENV variable to set the API key if the ParameterStore isn't used. (#40) 2024-12-06 14:32:06 +08:00
Fabian Fischer 25b3cfb146 feat: add amazon nova inference profiles in us (#79) 2024-12-06 13:52:50 +08:00
mschfh 17503b032a Add cross-region inference profiles for Llama 3.2 models. (#75) 2024-12-05 11:22:11 +08:00
bkocik 6849ca828a Add cross-region inference profiles for Llama 3.1 models. (#72) 2024-11-20 09:57:35 +08:00
KAEYL98 11a31b5584 feat: add support for APAC claude 3 profiles (#69) 2024-11-07 16:43:15 +08:00
heisenbergye 5f7676608a suppot all Claude models Cross-Region Inference (#65) 2024-10-29 14:43:31 +08:00
Sergei Mikhailov 3a97677b97 Added "new Claude 3.5 Sonnet" v2 model to the list (#60) 2024-10-23 14:54:45 +08:00
Meng Xin Zhu c1ee1b4244 chore: add automation script to release images (#58) 2024-10-09 18:20:14 +08:00
Yuki Sekiya c655f50616 feat: Handle multiple user messages in a single request (#26) 2024-10-09 15:13:58 +08:00
diopres db0817392f feat: add support for Mistral Large 2 (24.07)
added support for Mistral Large 2 (24.07)
2024-08-12 19:06:44 +05:30
Aiden Dai 2950c15ecb Fix empty response bug 2024-08-09 17:28:09 +08:00
Aiden Dai f8faf32a76 Add Llama 3.1 without tool call 2024-07-30 12:27:08 +08:00
Aiden Dai f6b73152bc Update boto3 version 2024-06-25 17:29:47 +08:00
Aiden Dai 66bdfdf5c1 Support Claude 3.5 Sonnet 2024-06-21 10:28:04 +08:00
Aiden Dai 49dd6608a0 Support of tool choice 2024-06-21 10:24:11 +08:00
Aiden Dai b3509ee0f0 Support multiple tool calls 2024-06-11 16:58:26 +08:00
Aiden Dai 56786f9e32 Update api response 2024-06-11 10:53:56 +08:00
Aiden Dai 6ef7641a0d Update api response 2024-06-07 10:58:44 +08:00
Aiden Dai 5f84cef13a Refactor to use new Converse API 2024-06-04 17:01:06 +08:00
Aiden Dai f0ea117732 Refactor to use new Converse API 2024-06-04 16:20:25 +08:00
Aiden Dai 696039053d Refactor to use new Converse API 2024-06-04 14:59:40 +08:00
dependabot[bot] c7276171ad ---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-05-21 08:06:48 +00:00
Aiden Dai 9f6b334385 Refactor model implementation 2024-05-09 16:58:04 +08:00
Aiden Dai 180c199da9 Add base64 encoded embedding support 2024-04-26 13:46:46 +08:00