Laisky.Cai
c936198ac8
feat: add Proxy channel type and relay mode ( #1678 )
...
Publish Docker image (English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image / Push Docker image to multiple registries (push) Has been cancelled
Linux Release / release (push) Has been cancelled
macOS Release / release (push) Has been cancelled
Windows Release / release (push) Has been cancelled
Add the Proxy channel type and relay mode to support proxying requests to custom upstream services.
2024-07-22 22:51:19 +08:00
zijiren
a3eefb7af0
fix: rate limit can be zero ( #1643 )
2024-07-14 18:03:23 +08:00
Zhong Liu
c1971870fa
fix: support for Spark Lite model ( #1526 )
...
* fix: Support for Spark Lite model
* fix: fix panic
* fix: fix xunfei version config
---------
Co-authored-by: JustSong <39998050+songquanpeng@users.noreply.github.com>
Co-authored-by: JustSong <songquanpeng@foxmail.com>
2024-06-13 00:07:26 +08:00
JustSong
9026ec7510
feat: support cloudflare now
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2024-04-26 23:05:48 +08:00
JustSong
3d149fedf4
chore: do not hardcode context key
2024-04-21 19:43:23 +08:00
JustSong
e30ebda0fe
chore: move config key to package ctxkey
2024-04-21 18:55:13 +08:00
Laisky.Cai
fc9a784950
feat: support aws bedrockruntime claude3 ( #1328 )
...
* feat: support aws bedrockruntime claude3
closes #622 , closes #749 , closes #1300
* fix: convert to aws claude model id
* fix: Update AWS adapter to handle stream completions and calculate usage metrics
Based on the file summaries provided, here are the important bullet points for the commit message:
- Add functionality to handle stream completion events from AWS in the relay/adaptor/aws/main.go file
- Marshall AWS response to OpenAI format and calculate usage metrics in the same file
- Implement a custom render function for streaming events in the same file
- Improve error handling for JSON unmarshalling and marshalling errors in the same file
* fix: Implement AWS handler with usage tracking and error handling
- Implemented streaming response handling for AWS handler
- Set response content type to text/event-stream
- Added error handling for failed marshaling/unmarshaling
- Updated return values to include `relaymodel.ErrorWithStatusCode` and `relaymodel.Usage`
- Improved error handling and response formatting for AWS adaptor
* fix: Refactor AWS Adapter for Improved Model Mapping and Error Handling
* Refactor AWS adapter to improve model management
- Replace hardcoded model list in `adapter.go` with a function to get models from `awsModelIDMap`
- Update `GetModelList` function to return model list directly
- Add `GetChannelName` function to get channel name from `Adaptor` object
* Improve error handling and code organization in main.go
- Replace switch statement with a map to map AWS model IDs to OpenAI model IDs
- Return an error if the model is not found in the map
- Use a single return statement instead of wrapping multiple return statements in the `awsModelID` function
- Add a new error message for when the model is not found in the map in the `Handler` function
* fix: bug fix
* chore: change variable name & package
* chore: change variable name
* perf: update config related code
---------
Co-authored-by: JustSong <songquanpeng@foxmail.com>
2024-04-20 00:40:47 +08:00
JustSong
7bf61f9165
fix: fix retry not working ( close #1314 )
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (arm64) / Push Docker image to multiple registries (push) Has been cancelled
Linux Release / release (push) Has been cancelled
macOS Release / release (push) Has been cancelled
Windows Release / release (push) Has been cancelled
2024-04-15 23:09:12 +08:00
JustSong
3af4649b52
fix: only check model when request path in whitelist
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2024-04-06 20:42:35 +08:00
JustSong
0b8ccb94eb
chore: reorganize common package
2024-04-06 02:03:59 +08:00
JustSong
f9d914873f
chore: reorganize constant related package
2024-04-06 00:44:33 +08:00
JustSong
348adc2b02
feat: able to set multiple subnets
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2024-04-05 17:25:28 +08:00
JustSong
840ef80d94
fix: do not try to parse model when requesting /v1/models ( close #1272 )
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2024-04-05 12:50:31 +08:00
JustSong
c49778c254
feat: now able to limit ip range for token now ( close #1275 )
2024-04-05 10:09:16 +08:00
JustSong
8b9813d63b
feat: /v1/models now only return available models
2024-04-04 02:44:59 +08:00
JustSong
dc7aaf2de5
feat: able to set model limitation for token ( close #178 )
2024-04-04 02:08:18 +08:00
JustSong
2dcef85285
feat: support ollama now ( close #870 )
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2024-03-14 01:02:47 +08:00
JustSong
45940dcb12
chore: add more info for panic fix
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2024-03-10 23:59:35 +08:00
JustSong
6ebc99460e
fix: add user to blacklist when it's banned or deleted, and make deletion soft ( close #473 , close #791 )
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2024-03-10 15:56:19 +08:00
JustSong
2df877a352
feat: switch priority when retry ( close #1048 )
2024-03-03 22:14:07 +08:00
JustSong
565ea58e68
feat: built in retry supported ( close #1036 , close #770 )
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2024-02-25 19:01:49 +08:00
JustSong
de9a58ca0b
refactor: use config field to save config
2024-02-18 02:22:50 +08:00
JustSong
2cd1a78203
chore: update module name
2024-01-28 19:38:58 +08:00
JustSong
2d760d4a01
refactor: refactor relay part ( #957 )
...
* refactor: refactor relay part
* refactor: refactor config part
2024-01-21 23:21:42 +08:00
JustSong
1c8922153d
feat: support gemini-vision-pro
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2023-12-24 18:54:32 +08:00
David Zhuang
5cf23d8698
feat: add Google Gemini Pro support ( #826 )
...
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
* fest: Add Google Gemini Pro, fix #810
* fest: Add tooling to Gemini; Add OpenAI-like system prompt to Gemini
* refactor: removing unused if statement
* fest: Add dummy model message for system message in gemini model
* chore: update implementation
---------
Co-authored-by: JustSong <songquanpeng@foxmail.com>
2023-12-17 12:48:32 +08:00
JustSong
2a70744dbf
feat: add panic recover middleware
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2023-12-10 19:53:33 +08:00
JustSong
379074f7d0
feat: support plugin for ali channel ( close #797 )
2023-12-10 17:22:52 +08:00
igophper
d85e356b6e
refactor: remove consumeQuota related logic ( #738 )
...
* feat: 删除relay-text中的consumeQuota变量
该变量始终为true，可以删除
* chore: remove useless code
---------
Co-authored-by: JustSong <songquanpeng@foxmail.com>
2023-11-24 20:42:29 +08:00
ckt1031
ddcaf95f5f
feat: support tts model ( #713 )
...
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
* Added support for Text-to-Speech models and
endpoints
* chore: update impl
---------
Co-authored-by: JustSong <songquanpeng@foxmail.com>
2023-11-17 21:18:51 +08:00
JustSong
b4b4acc288
feat: support Tencent's model ( close #519 )
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2023-10-03 14:19:03 +08:00
JustSong
f9b748c2ca
chore: add MEMORY_CACHE_ENABLED env variable
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2023-09-29 11:38:27 +08:00
JustSong
159b9e3369
fix: fix unable to set zero value for base url & model mapping
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2023-09-18 22:07:17 +08:00
JustSong
42451d9d02
refactor: update logging related logic
2023-09-17 15:39:46 +08:00
JustSong
621eb91b46
chore: pass through error out
2023-09-03 21:31:58 +08:00
JustSong
04acdb1ccb
feat: support aiproxy's library
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2023-09-03 12:51:59 +08:00
JustSong
d09d317459
feat: supper whisper now ( close #197 )
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2023-08-27 15:28:23 +08:00
滔哥
7e058bfb9b
feat: support xunfei's v2 api ( #442 , close #440 )
...
* 兼容讯飞v2接口
* Revert "兼容讯飞v2接口"
This reverts commit 21f05d1294b8693d0a21664a23ec04f028b9b117.
* fix: fix implementation
---------
Co-authored-by: JustSong <songquanpeng@foxmail.com>
Co-authored-by: JustSong <39998050+songquanpeng@users.noreply.github.com>
2023-08-19 17:50:34 +08:00
JustSong
c87e05bfc2
chore: add more context in error message
2023-07-23 09:49:46 +08:00
ckt
b520b54625
feat: initial support of Dall-E ( #148 , #266 )
...
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
* feat: initial support of Dall-E
* fix: fix N not timed
---------
Co-authored-by: JustSong <songquanpeng@foxmail.com>
Co-authored-by: JustSong <39998050+songquanpeng@users.noreply.github.com>
2023-07-15 12:30:06 +08:00
玩牛牛
81c5901123
feat: add support for /v1/engines/text-embedding-ada-002/embeddings ( #224 , close #222 )
2023-07-15 12:03:23 +08:00
JustSong
aabc546691
fix: fix the wrong message when channel is deleted
2023-06-29 11:27:34 +08:00
JustSong
0941e294bf
feat: support model remap now
Publish Docker image (amd64, English) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2023-06-27 13:42:45 +08:00
JustSong
8a4cd403fd
fix: fix http status code ( close #193 )
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2023-06-23 22:59:44 +08:00
JustSong
6d961064d2
feat: do not access database before response return ( close #158 )
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
2023-06-21 17:26:26 +08:00
JustSong
634099e592
fix: cors allow all headers
2023-06-20 22:04:01 +08:00
JustSong
3d76a974d1
feat: use cache to avoid database access ( #158 )
2023-06-20 19:09:49 +08:00
JustSong
6855d0dc39
chore: add x-requested-with header in CORS setting
Publish Docker image (amd64) / Push Docker image to multiple registries (push) Has been cancelled
Publish Docker image (arm64) / Push Docker image to multiple registries (push) Has been cancelled
Linux Release / release (push) Has been cancelled
macOS Release / release (push) Has been cancelled
Windows Release / release (push) Has been cancelled
2023-06-17 15:30:14 +08:00
Miniers
46c43396d8
feat: add token name to log ( #172 )
...
* add token name to log
* chore: update expression
---------
Co-authored-by: JustSong <songquanpeng@foxmail.com>
2023-06-17 14:56:03 +08:00
JustSong
596446dba4
feat: able to set group ratio now ( close #62 , close #142 )
2023-06-11 11:08:16 +08:00
