liunux4odoo
|
6a03611750
|
fix api and webui: (#1435)
1. fix #1431: 优化知识库问答与搜索引擎问答的API接口，避免docs重复返回
2. startup.py根据configs.log_verbose控制log级别
3. 修复/llm_model/list_models的bug:
只有一个参数时，fastapi未返回json导致视图函数出错
|
2023-09-12 08:31:17 +08:00 |
|
liunux4odoo
|
22ff073309
|
修改Embeddings和FAISS缓存加载方式，知识库相关API接口支持多线程并发 (#1434)
* 修改Embeddings和FAISS缓存加载方式，支持多线程，支持内存FAISS
* 知识库相关API接口支持多线程并发
* 根据新的API接口调整ApiRequest和测试用例
* 删除webui.py失效的启动说明
|
2023-09-11 20:41:41 +08:00 |
glide-the
|
5550e3c1a9
|
增加显示详细日志开关
|
2023-09-08 20:48:31 +08:00 |
liunux4odoo
|
16fb19d2c3
|
优化LLM和Embedding模型运行设备配置，可设为auto自动检测
|
2023-08-31 17:41:09 +08:00 |
|
liunux4odoo
|
34a416b941
|
优化server_config配置项 (#1293)
* update server_config.py:
- 在model_config中增加HISTORY_LEN配置参数
- 将server_config中helper function移动到server.utils中
- 统一set_httpx_timeout的定义和调用
* update webui.py:
应用model_config中的配置项：HISTORY_LEN,VECTOR_SEARCH_TOP_K,SEARCH_ENGINE_TOP_K
---------
Co-authored-by: liunux4odoo <liunu@qq.com>
|
2023-08-29 10:06:09 +08:00 |
liunux4odoo
|
6c00c03faa
|
llm_api can be terminated by Ctrl+c. success on windows
|
2023-08-16 17:48:55 +08:00 |
|
liunux4odoo
|
8ed1f8efca
|
update fastchat to 0.2.24
|
2023-08-16 16:15:45 +08:00 |
|
liunux4odoo
|
f64affc930
|
update llm_api and api server:
1. fastchat's controller/model_worker/api_server use swagger UI offline.
2. add custom title and icon.
3. remove fastapi-offline dependence
|
2023-08-16 14:20:09 +08:00 |
hzg0601
|
6590ca32db
|
更新多卡部署
|
2023-08-14 11:24:52 +08:00 |
imClumsyPanda
|
8a4d9168fa
|
update import pkgs and format
|
2023-08-10 21:26:05 +08:00 |
|
liunux4odoo
|
ba3335efb8
|
update llm_api: move fastchat logs to LOG_PATH
|
2023-08-09 22:43:45 +08:00 |
|
liunux4odoo
|
f7d465b7d4
|
bug fix
|
2023-08-03 12:11:18 +08:00 |
|
hzg0601
|
18a94fcf45
|
Merge branch 'dev_fastchat' of github.com:chatchat-space/langchain-ChatGLM into dev_fastchat
|
2023-08-01 18:02:52 +08:00 |
|
hzg0601
|
15e67a4d3e
|
1.*在config里将所有fastchat的命令行参数加入;2.*加入启动和停止fastchat的shell脚本；3. **增加了通过命令行启动所有fastchat服务的python脚本llm_api_sh.py;4. 修改了默认的config日志格式
|
2023-08-01 17:59:20 +08:00 |
|
imClumsyPanda
|
c8a75ab11f
|
update llm_api.py and webui.py
|
2023-08-01 14:33:18 +08:00 |
|
liunux4odoo
|
9e2b411b01
|
cuda error with multiprocessing, change model_worker to main process
|
2023-07-31 11:18:57 +08:00 |
|
hzg0601
|
47dfb6cd8b
|
udpate llm_api
|
2023-07-31 11:00:33 +08:00 |
|
liunux4odoo
|
463659f0ba
|
llm_api升级到fschat==0.2.20，支持百川模型
|
2023-07-30 23:16:47 +08:00 |
|
imClumsyPanda
|
05ccc0346e
|
update test code
|
2023-07-30 00:48:07 +08:00 |
|
imClumsyPanda
|
41444fd4b5
|
update requirements.txt and llm_api.py
|
2023-07-30 00:24:34 +08:00 |
|
liunux4odoo
|
1a7271e966
|
fix: model_worker need global variable: args
|
2023-07-29 23:22:25 +08:00 |
|
liunux4odoo
|
c880412300
|
use multiprocessing to run fastchat server
|
2023-07-29 23:01:24 +08:00 |
|
hzg0601
|
97ee4686a1
|
更新会议记录
|
2023-07-28 16:16:59 +08:00 |
|
hzg0601
|
154cad1b45
|
会议记录
|
2023-07-28 16:12:57 +08:00 |
|
imClumsyPanda
|
dcf49a59ef
|
v0.2.0 first commit
|
2023-07-27 23:22:07 +08:00 |