liunux4odoo
|
b1201a5f23
|
优化LLM和Embedding模型运行设备配置，可设为auto自动检测；修复：重建知识库时FAISS未保存 (#1330)
* 避免configs对torch的依赖；
* webui自动从configs获取api地址(close #1319)
* bug fix: 重建知识库时FAISS未保存
* 优化LLM和Embedding模型运行设备配置，可设为auto自动检测
|
2023-08-31 17:44:48 +08:00 |
|
liunux4odoo
|
34a416b941
|
优化server_config配置项 (#1293)
* update server_config.py:
- 在model_config中增加HISTORY_LEN配置参数
- 将server_config中helper function移动到server.utils中
- 统一set_httpx_timeout的定义和调用
* update webui.py:
应用model_config中的配置项：HISTORY_LEN,VECTOR_SEARCH_TOP_K,SEARCH_ENGINE_TOP_K
---------
Co-authored-by: liunux4odoo <liunu@qq.com>
|
2023-08-29 10:06:09 +08:00 |
liunux4odoo
|
6c00c03faa
|
llm_api can be terminated by Ctrl+c. success on windows
|
2023-08-16 17:48:55 +08:00 |
|
liunux4odoo
|
8ed1f8efca
|
update fastchat to 0.2.24
|
2023-08-16 16:15:45 +08:00 |
|
liunux4odoo
|
f64affc930
|
update llm_api and api server:
1. fastchat's controller/model_worker/api_server use swagger UI offline.
2. add custom title and icon.
3. remove fastapi-offline dependence
|
2023-08-16 14:20:09 +08:00 |
hzg0601
|
6590ca32db
|
更新多卡部署
|
2023-08-14 11:24:52 +08:00 |
imClumsyPanda
|
8a4d9168fa
|
update import pkgs and format
|
2023-08-10 21:26:05 +08:00 |
|
liunux4odoo
|
ba3335efb8
|
update llm_api: move fastchat logs to LOG_PATH
|
2023-08-09 22:43:45 +08:00 |
liunux4odoo
|
f7d465b7d4
|
bug fix
|
2023-08-03 12:11:18 +08:00 |
|
hzg0601
|
18a94fcf45
|
Merge branch 'dev_fastchat' of github.com:chatchat-space/langchain-ChatGLM into dev_fastchat
|
2023-08-01 18:02:52 +08:00 |
|
hzg0601
|
15e67a4d3e
|
1.*在config里将所有fastchat的命令行参数加入;2.*加入启动和停止fastchat的shell脚本；3. **增加了通过命令行启动所有fastchat服务的python脚本llm_api_sh.py;4. 修改了默认的config日志格式
|
2023-08-01 17:59:20 +08:00 |
|
imClumsyPanda
|
c8a75ab11f
|
update llm_api.py and webui.py
|
2023-08-01 14:33:18 +08:00 |
|
liunux4odoo
|
9e2b411b01
|
cuda error with multiprocessing, change model_worker to main process
|
2023-07-31 11:18:57 +08:00 |
|
hzg0601
|
47dfb6cd8b
|
udpate llm_api
|
2023-07-31 11:00:33 +08:00 |
|
liunux4odoo
|
463659f0ba
|
llm_api升级到fschat==0.2.20，支持百川模型
|
2023-07-30 23:16:47 +08:00 |
|
imClumsyPanda
|
05ccc0346e
|
update test code
|
2023-07-30 00:48:07 +08:00 |
|
imClumsyPanda
|
41444fd4b5
|
update requirements.txt and llm_api.py
|
2023-07-30 00:24:34 +08:00 |
|
liunux4odoo
|
1a7271e966
|
fix: model_worker need global variable: args
|
2023-07-29 23:22:25 +08:00 |
|
liunux4odoo
|
c880412300
|
use multiprocessing to run fastchat server
|
2023-07-29 23:01:24 +08:00 |
|
hzg0601
|
97ee4686a1
|
更新会议记录
|
2023-07-28 16:16:59 +08:00 |
|
hzg0601
|
154cad1b45
|
会议记录
|
2023-07-28 16:12:57 +08:00 |
|
imClumsyPanda
|
dcf49a59ef
|
v0.2.0 first commit
|
2023-07-27 23:22:07 +08:00 |