redline/one-api
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
885 Commits 7 Branches 405 Tags
Commit Graph

36 Commits

Author SHA1 Message Date
JustSong
e30ebda0fe chore: move config key to package ctxkey 2024-04-21 18:55:13 +08:00
Laisky.Cai
fc9a784950
feat: support aws bedrockruntime claude3 (#1328) 
* feat: support aws bedrockruntime claude3

closes #622, closes #749, closes #1300

* fix: convert to aws claude model id

* fix: Update AWS adapter to handle stream completions and calculate usage metrics

Based on the file summaries provided, here are the important bullet points for the commit message:

- Add functionality to handle stream completion events from AWS in the relay/adaptor/aws/main.go file
- Marshall AWS response to OpenAI format and calculate usage metrics in the same file
- Implement a custom render function for streaming events in the same file
- Improve error handling for JSON unmarshalling and marshalling errors in the same file

* fix: Implement AWS handler with usage tracking and error handling

- Implemented streaming response handling for AWS handler
- Set response content type to text/event-stream
- Added error handling for failed marshaling/unmarshaling
- Updated return values to include `relaymodel.ErrorWithStatusCode` and `relaymodel.Usage`
- Improved error handling and response formatting for AWS adaptor

* fix: Refactor AWS Adapter for Improved Model Mapping and Error Handling

* Refactor AWS adapter to improve model management
  - Replace hardcoded model list in `adapter.go` with a function to get models from `awsModelIDMap`
  - Update `GetModelList` function to return model list directly
  - Add `GetChannelName` function to get channel name from `Adaptor` object
* Improve error handling and code organization in main.go
  - Replace switch statement with a map to map AWS model IDs to OpenAI model IDs
  - Return an error if the model is not found in the map
  - Use a single return statement instead of wrapping multiple return statements in the `awsModelID` function
  - Add a new error message for when the model is not found in the map in the `Handler` function

* fix: bug fix

* chore: change variable name & package

* chore: change variable name

* perf: update config related code

---------

Co-authored-by: JustSong <songquanpeng@foxmail.com>
 2024-04-20 00:40:47 +08:00
JustSong
7bf61f9165 fix: fix retry not working (close #1314)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (arm64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Linux Release / release (push) Has been cancelled
Details
macOS Release / release (push) Has been cancelled
Details
Windows Release / release (push) Has been cancelled
Details
2024-04-15 23:09:12 +08:00
JustSong
0b8ccb94eb chore: reorganize common package 2024-04-06 02:03:59 +08:00
JustSong
f9d914873f chore: reorganize constant related package 2024-04-06 00:44:33 +08:00
JustSong
dc7aaf2de5 feat: able to set model limitation for token (close #178) 2024-04-04 02:08:18 +08:00
JustSong
2df877a352 feat: switch priority when retry (close #1048) 2024-03-03 22:14:07 +08:00
JustSong
565ea58e68 feat: built in retry supported (close #1036, close #770)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-02-25 19:01:49 +08:00
JustSong
de9a58ca0b refactor: use config field to save config 2024-02-18 02:22:50 +08:00
JustSong
2cd1a78203 chore: update module name 2024-01-28 19:38:58 +08:00
JustSong
2d760d4a01
refactor: refactor relay part (#957) 
* refactor: refactor relay part

* refactor: refactor config part
 2024-01-21 23:21:42 +08:00
David Zhuang
5cf23d8698
feat: add Google Gemini Pro support (#826)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details 
* fest: Add Google Gemini Pro, fix #810

* fest: Add tooling to Gemini; Add OpenAI-like system prompt to Gemini

* refactor: removing unused if statement

* fest: Add dummy model message for system message in gemini model

* chore: update implementation

---------

Co-authored-by: JustSong <songquanpeng@foxmail.com>
 2023-12-17 12:48:32 +08:00
JustSong
379074f7d0 feat: support plugin for ali channel (close #797) 2023-12-10 17:22:52 +08:00
ckt1031
ddcaf95f5f
feat: support tts model (#713)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details 
* Added support for Text-to-Speech models and
endpoints

* chore: update impl

---------

Co-authored-by: JustSong <songquanpeng@foxmail.com>
 2023-11-17 21:18:51 +08:00
JustSong
b4b4acc288 feat: support Tencent's model (close #519)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2023-10-03 14:19:03 +08:00
JustSong
159b9e3369 fix: fix unable to set zero value for base url & model mapping
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2023-09-18 22:07:17 +08:00
JustSong
42451d9d02 refactor: update logging related logic 2023-09-17 15:39:46 +08:00
JustSong
04acdb1ccb feat: support aiproxy's library
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2023-09-03 12:51:59 +08:00
JustSong
d09d317459 feat: supper whisper now (close #197)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2023-08-27 15:28:23 +08:00
滔哥
7e058bfb9b
feat: support xunfei's v2 api (#442, close #440) 
* 兼容讯飞v2接口

* Revert "兼容讯飞v2接口"

This reverts commit 21f05d1294b8693d0a21664a23ec04f028b9b117.

* fix: fix implementation

---------

Co-authored-by: JustSong <songquanpeng@foxmail.com>
Co-authored-by: JustSong <39998050+songquanpeng@users.noreply.github.com>
 2023-08-19 17:50:34 +08:00
JustSong
c87e05bfc2 chore: add more context in error message 2023-07-23 09:49:46 +08:00
ckt
b520b54625
feat: initial support of Dall-E (#148, #266)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details 
* feat: initial support of Dall-E

* fix: fix N not timed

---------

Co-authored-by: JustSong <songquanpeng@foxmail.com>
Co-authored-by: JustSong <39998050+songquanpeng@users.noreply.github.com>
 2023-07-15 12:30:06 +08:00
玩牛牛
81c5901123
feat: add support for /v1/engines/text-embedding-ada-002/embeddings (#224, close #222) 2023-07-15 12:03:23 +08:00
JustSong
aabc546691 fix: fix the wrong message when channel is deleted 2023-06-29 11:27:34 +08:00
JustSong
0941e294bf feat: support model remap now
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2023-06-27 13:42:45 +08:00
JustSong
8a4cd403fd fix: fix http status code (close #193)
Some checks failed
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2023-06-23 22:59:44 +08:00
JustSong
3d76a974d1 feat: use cache to avoid database access (#158) 2023-06-20 19:09:49 +08:00
JustSong
596446dba4 feat: able to set group ratio now (close #62, close #142) 2023-06-11 11:08:16 +08:00
JustSong
4339f45f74 feat: support /v1/moderations now (close #117) 2023-06-11 09:37:36 +08:00
JustSong
8901f03864 feat: support set proxy for channel OpenAI (close #139)
Some checks failed
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (arm64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Linux Release / release (push) Has been cancelled
Details
macOS Release / release (push) Has been cancelled
Details
Windows Release / release (push) Has been cancelled
Details
2023-06-09 18:30:01 +08:00
JustSong
2ad22e1425 feat: support group now (close #17, close #72, close #85, close #104, close #136) 
Co-authored-by: quzard <1191890118@qq.com>
 2023-06-07 23:26:00 +08:00
JustSong
a1f61384c5 feat: automatically disable channel when error occurred (#59)
Some checks failed
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (arm64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Linux Release / release (push) Has been cancelled
Details
macOS Release / release (push) Has been cancelled
Details
Windows Release / release (push) Has been cancelled
Details
2023-05-15 17:34:09 +08:00
JustSong
83e86b9f8a feat: support specific default api version now (#57)
Some checks failed
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (arm64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Linux Release / release (push) Has been cancelled
Details
macOS Release / release (push) Has been cancelled
Details
Windows Release / release (push) Has been cancelled
Details
2023-05-13 12:53:57 +08:00
JustSong
7a3378b4b7 feat: Azure API supported without verification (#48, #57) 2023-05-13 11:36:36 +08:00
JustSong
b3be4d8f85 Support custom channel now
Some checks failed
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (arm64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Linux Release / release (push) Has been cancelled
Details
macOS Release / release (push) Has been cancelled
Details
Windows Release / release (push) Has been cancelled
Details
2023-04-23 20:35:49 +08:00
JustSong
852af57c03 Relay done but not working 2023-04-23 18:24:11 +08:00