redline/one-api
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
871 Commits 7 Branches 405 Tags
Commit Graph

331 Commits

Author SHA1 Message Date
Laisky.Cai
fc9a784950
feat: support aws bedrockruntime claude3 (#1328) 
* feat: support aws bedrockruntime claude3

closes #622, closes #749, closes #1300

* fix: convert to aws claude model id

* fix: Update AWS adapter to handle stream completions and calculate usage metrics

Based on the file summaries provided, here are the important bullet points for the commit message:

- Add functionality to handle stream completion events from AWS in the relay/adaptor/aws/main.go file
- Marshall AWS response to OpenAI format and calculate usage metrics in the same file
- Implement a custom render function for streaming events in the same file
- Improve error handling for JSON unmarshalling and marshalling errors in the same file

* fix: Implement AWS handler with usage tracking and error handling

- Implemented streaming response handling for AWS handler
- Set response content type to text/event-stream
- Added error handling for failed marshaling/unmarshaling
- Updated return values to include `relaymodel.ErrorWithStatusCode` and `relaymodel.Usage`
- Improved error handling and response formatting for AWS adaptor

* fix: Refactor AWS Adapter for Improved Model Mapping and Error Handling

* Refactor AWS adapter to improve model management
  - Replace hardcoded model list in `adapter.go` with a function to get models from `awsModelIDMap`
  - Update `GetModelList` function to return model list directly
  - Add `GetChannelName` function to get channel name from `Adaptor` object
* Improve error handling and code organization in main.go
  - Replace switch statement with a map to map AWS model IDs to OpenAI model IDs
  - Return an error if the model is not found in the map
  - Use a single return statement instead of wrapping multiple return statements in the `awsModelID` function
  - Add a new error message for when the model is not found in the map in the `Handler` function

* fix: bug fix

* chore: change variable name & package

* chore: change variable name

* perf: update config related code

---------

Co-authored-by: JustSong <songquanpeng@foxmail.com>
 2024-04-20 00:40:47 +08:00
JustSong
0b8ccb94eb chore: reorganize common package 2024-04-06 02:03:59 +08:00
JustSong
f586ae0ad8 chore: remove helper & util subpackage for relay 2024-04-06 01:50:12 +08:00
JustSong
24ed170e7b chore: reorganize adaptor related package 2024-04-06 01:36:48 +08:00
JustSong
f70506eac1 chore: reorganize relay related package 2024-04-06 01:31:44 +08:00
JustSong
8f4d78e24d chore: reorganize billing related package 2024-04-06 01:26:48 +08:00
JustSong
2ab7d25a80 chore: reorganize helper related package 2024-04-06 01:02:35 +08:00
JustSong
f9d914873f chore: reorganize constant related package 2024-04-06 00:44:33 +08:00
JustSong
a44fb5d482 fix: fix channel model list is empty
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-04-05 23:44:57 +08:00
JustSong
348adc2b02 feat: able to set multiple subnets
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-04-05 17:25:28 +08:00
JustSong
4d61b9937b feat: support feishu login now 2024-04-05 12:10:43 +08:00
JustSong
68605800af feat: add subnet validation (#1275)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-04-05 10:18:42 +08:00
JustSong
c49778c254 feat: now able to limit ip range for token now (close #1275) 2024-04-05 10:09:16 +08:00
JustSong
0a37aa4cbd docs: add API docs 2024-04-05 01:10:30 +08:00
JustSong
fb90747c23 fix: fix /v1/models return null data when no models available 2024-04-04 18:53:42 +08:00
JustSong
ed70881a58 fix: fix token create
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-04-04 11:18:21 +08:00
JustSong
8b9813d63b feat: /v1/models now only return available models 2024-04-04 02:44:59 +08:00
JustSong
dc7aaf2de5 feat: able to set model limitation for token (close #178) 2024-04-04 02:08:18 +08:00
JustSong
24be9de098 chore: update copy 2024-03-24 23:01:03 +08:00
JustSong
cdfdeea3b4 feat: return token when calling post /api/token (close #1208) 2024-03-24 22:24:41 +08:00
Benny
9821bc7281
feat: add user list sorting and pagination enhancements (#1178) 
* feat: add user list sorting and pagination enhancements

* feat: add user list sorting for THEME=air

* feat: add token list sorting and pagination enhancements

* feat: add token list sorting for THEME=air
 2024-03-17 19:25:36 +08:00
JustSong
f33555ae78 fix: update max token for test (close #1154) 2024-03-14 23:17:19 +08:00
JustSong
e99150bdb9 fix: make quota int64 2024-03-13 20:00:51 +08:00
JustSong
7e7369dbc4 fix: only disable channel when allowed 2024-03-10 23:41:16 +08:00
JustSong
e54e647170 chore: remove useless code 2024-03-10 23:36:29 +08:00
JustSong
5b50eb94e5 feat: able to send alert message via message pusher (close #993)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-03-10 19:16:06 +08:00
JustSong
71c61365eb feat: able to only test disabled channels (#1090)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-03-10 18:34:57 +08:00
JustSong
12440874b0 feat: able to disable channel by success rate
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-03-10 17:57:47 +08:00
JustSong
b33616df44 feat: support groq now (close #1087)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-03-10 14:09:44 +08:00
JustSong
cf16f44970 feat: load channel models from server
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-03-09 02:28:23 +08:00
JustSong
95cfb8e8c9 fix: using the first available model if default model is not found (close #1021)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-03-03 22:58:41 +08:00
JustSong
10a926b8f3 feat: only use the top priority when first retry (#1048) 2024-03-03 22:16:34 +08:00
JustSong
2df877a352 feat: switch priority when retry (close #1048) 2024-03-03 22:14:07 +08:00
JustSong
9d8967f7d3 feat: support Mistral's models now (close #1051) 2024-03-03 21:46:45 +08:00
JustSong
82e916b5ff fix: fix azure test (close #1069) 2024-03-03 20:51:28 +08:00
JustSong
df1fd9aa81 feat: support minimax's models now (close #354) 2024-03-02 01:24:28 +08:00
JustSong
614c2e0442 feat: support baichuan's models now (close #1057)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-03-02 00:55:48 +08:00
JustSong
b747cdbc6f fix: fix getAndValidateTextRequest failed: unexpected end of JSON input (close #1043)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (arm64) / Push Docker image to multiple registries (push) Has been cancelled
Details
Linux Release / release (push) Has been cancelled
Details
macOS Release / release (push) Has been cancelled
Details
Windows Release / release (push) Has been cancelled
Details
2024-02-26 22:52:16 +08:00
JustSong
565ea58e68 feat: built in retry supported (close #1036, close #770)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-02-25 19:01:49 +08:00
JustSong
cece77e533 fix: fix model list
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-02-19 22:20:18 +08:00
JustSong
2acc2f5017 feat: support moonshot now (close #804) 2024-02-18 16:17:19 +08:00
JustSong
1aa374ccfb refactor: use adaptor to do relay & test 2024-02-18 00:15:31 +08:00
Laisky.Cai
d548a01c59
feat: Handle errors, validate model names, and calculate quota usage (#978) 
- Improved error handling in various modules for better stability and responsiveness.
- Optimized code in several files for improved efficiency and readability.
- Enhanced user experience by providing more detailed error responses in the controller.
- Strengthened security by ignoring sensitive files in `.gitignore`.
 2024-02-12 21:35:40 +08:00
JustSong
2cd1a78203 chore: update module name 2024-01-28 19:38:58 +08:00
JustSong
b9d3cb0c45 refactor: split RelayTextHelper function
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-01-28 19:14:46 +08:00
Benny
26e2e646cb
feat: sync models with OpenAI (#971) 
* add new 0125 chat models and embedding-3 models

* refine the step of manually deploying

* add gpt-4-turbo-preview
 2024-01-28 16:09:21 +08:00
JustSong
2d760d4a01
refactor: refactor relay part (#957) 
* refactor: refactor relay part

* refactor: refactor config part
 2024-01-21 23:21:42 +08:00
JustSong
eed9f5fdf0
refactor: refactor relay part (#935)
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-01-14 19:21:03 +08:00
JustSong
bdd4be562d chore: add theme validation
Some checks failed
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Details
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Details
2024-01-07 18:44:26 +08:00
Buer
48989d4a0b
feat: add new theme berry (#860) 
* feat: add theme berry

* docs: add development notes

* fix: fix blank page

* chore: update implementation

* fix: fix package.json

* chore: update ui copy

---------

Co-authored-by: JustSong <songquanpeng@foxmail.com>
 2024-01-07 14:20:07 +08:00