Commit Graph

1427 Commits

Author SHA1 Message Date
imClumsyPanda 75f1e84b1f update autodl version 2023-09-05 18:15:43 +08:00
imClumsyPanda 780c1457d0 add support for shibing624/text2vec-bge-large-chinese 2023-09-05 18:04:21 +08:00
imClumsyPanda c24e00a386 fix streamlit-aggrid showing "For Trial Use Only" 2023-09-05 17:30:58 +08:00
glide-the 0b60a25f2a 知识库默认存储路径 默认自动创建 2023-09-05 17:27:43 +08:00
imClumsyPanda 3a706907ff Merge branch 'pre-release' into dev 2023-09-05 14:50:06 +08:00
imClumsyPanda 30c00ffac6 Merge branch 'master' into pre-release 2023-09-05 14:47:28 +08:00
imClumsyPanda 9da7313e7e update requirements.txt 2023-09-05 14:46:26 +08:00
imClumsyPanda 220b1bd9ae update requirements.txt 2023-09-05 13:41:08 +08:00
liunux4odoo 3e87530478 使zhipuai变为非必要依赖(close #1369) 2023-09-05 12:43:51 +08:00
liunux4odoo 464ccc6d53 Update migrate.py (#1371)
fix bug at line 85 : for kb_file in kb_file
2023-09-05 11:52:22 +08:00
TongTie 98e4fbaaa3 docs: Correcting a spelling mistake in README (#1367)
Co-authored-by: tongtie <tongtie@gmail.com>
2023-09-05 11:52:22 +08:00
liunux4odoo 015ce57691
Update migrate.py (#1371)
fix bug at line 85 : for kb_file in kb_file
2023-09-05 11:47:25 +08:00
TongTie 53d3fbc335
docs: Correcting a spelling mistake in README (#1367)
Co-authored-by: tongtie <tongtie@gmail.com>
2023-09-05 11:10:14 +08:00
imClumsyPanda 8ea75417ec update VERSION 2023-09-05 10:20:59 +08:00
imClumsyPanda d1b4dea2ca update VERSION 2023-09-05 10:19:14 +08:00
imClumsyPanda 44262da4e5 Merge branch 'dev' into pre-release 2023-09-05 10:02:37 +08:00
imClumsyPanda 3a7c1f2744 Merge branch 'master' into dev 2023-09-05 09:57:02 +08:00
imClumsyPanda 62aa17b9a4 clean up qr_code 2023-09-05 09:56:51 +08:00
liunux4odoo 053ebb82bf update startup.py:
1. controller改为自动等待
2. 修复:分部分启动时进程引用错误
2023-09-05 09:55:13 +08:00
imClumsyPanda 2275b1d84a fix place_holder mistake 2023-09-05 09:53:58 +08:00
imClumsyPanda 15619a1270 update model_config.py.example 2023-09-05 08:59:06 +08:00
glide-the 35f2c04535 启动进程放入 try catch 保证任务收到SIGINT后,能够正常退出 2023-09-04 23:03:56 +08:00
glide-the aa4a5ad224 CTRL-C exit with Python multiprocessing 2023-09-04 22:46:46 +08:00
liunux4odoo 93b133f9ac 将KnowledgeFile的file2text拆分成file2docs、docs2texts和file2text三个部分,在保持接口不变的情况下,实现:
1、支持chunk_size和chunk_overlap参数
2、支持自定义text_splitter
3、支持自定义docs
修复:csv文件不使用text_splitter
2023-09-04 21:00:16 +08:00
Zhi-guo Huang df23349584
Merge pull request #1361 from hzg0601/dev
update readme.md:1. 更改一键启动说明的顺序;2. 在一键启动中增加多卡启动的说明;3. 增加多卡启动gpus参数不生效的说明
2023-09-04 19:27:44 +08:00
hzg0601 8dce5f7e7c update readme.md:增加多卡启动gpus参数不生效的说明 2023-09-04 19:26:35 +08:00
hzg0601 b82ef5dcea update readme.md:1. 更改一键启动说明的顺序;2. 在一键启动中增加多卡启动的说明 2023-09-04 19:25:57 +08:00
zqt e21ca447af milvus/pg kb_service需要实现get_doc_by_id方法 2023-09-04 16:40:05 +08:00
liunux4odoo 8475a5dfd3
Merge branch 'chatchat-space:dev' into dev 2023-09-04 14:44:55 +08:00
imClumsyPanda 38e7c8299c
Update README.md 2023-09-04 10:29:30 +08:00
imClumsyPanda 857e689b8c
Add files via upload 2023-09-04 10:28:50 +08:00
liunux4odoo 0bc9d5c8ee
Merge branch 'dev' into opt_add_doc 2023-09-03 21:38:45 +08:00
imClumsyPanda 27e9ac57cf Merge branch 'master' into dev 2023-09-03 16:23:57 +08:00
imClumsyPanda e2354c215b clean up qr_code 2023-09-03 16:23:37 +08:00
imClumsyPanda a9035205ff Merge branch 'master' into dev 2023-09-03 16:22:08 +08:00
imClumsyPanda 4fae7d4884 add unit test for RapidOCRLoader and RapidOCRPDFLoader 2023-09-03 16:13:37 +08:00
imClumsyPanda 8a73673d6b update model_config.py.example 2023-09-03 15:57:44 +08:00
imClumsyPanda 9855bc6f55 update model_config.py.example 2023-09-03 15:52:17 +08:00
imClumsyPanda 25880ebd52 fix bug when config["device"]="auto" 2023-09-02 22:11:54 +08:00
glide-the 3de9b2649c 协程兼容python版本 2023-09-02 19:29:24 +08:00
glide-the d7c884e34a 注册器未启动时,整个启动链因为异常被终止
使用await asyncio.sleep(3)可以让后续代码等待一段时间,但不是最优解
2023-09-02 19:20:41 +08:00
imClumsyPanda 3391155077 update model_config.py.example 2023-09-02 15:33:57 +08:00
glide-the 3a660d4f74 TODO 2023-09-02 01:10:04 +08:00
liunux4odoo 6cb1bdf623
添加切换模型功能,支持智谱AI在线模型 (#1342)
* 添加LLM模型切换功能,需要在server_config中设置可切换的模型
* add tests for api.py/llm_model/*
* - 支持模型切换
- 支持智普AI线上模型
- startup.py增加参数`--api-worker`,自动运行所有的线上API模型。使用`-a
  (--all-webui), --all-api`时默认开启该选项
* 修复被fastchat覆盖的标准输出
* 对fastchat日志进行更细致的控制,startup.py中增加-q(--quiet)开关,可以减少无用的fastchat日志输出
* 修正chatglm api的对话模板


Co-authored-by: liunux4odoo <liunu@qq.com>
2023-09-01 23:58:09 +08:00
liunux4odoo 55e417a263 升级注意
数据库表发生变化,需要重建知识库

 新功能
- 增加FileDocModel库表,存储知识文件与向量库Document ID对应关系以及元数据,便于检索向量库
- 增加FileDocModel对应的数据库操作函数(这些函数主要是给KBService调用,用户一般无需使用):
  - list_docs_from_db: 根据知识库名称、文件名称、元数据检索对应的Document IDs
  - delete_docs_from_db: 根据知识库名称、文件名称删除对应的file-doc映射
  - add_docs_to_db: 添加对应的file-doc映射
- KBService增加list_docs方法,可以根据文件名、元数据检索Document。当前仅支持FAISS,待milvus/pg实现get_doc_by_id方法后即自动支持。
- 去除server.utils对torch的依赖

 待完善
- milvus/pg kb_service需要实现get_doc_by_id方法
2023-09-01 22:54:57 +08:00
liunux4odoo 96770cca53
Merge branch 'chatchat-space:dev' into dev 2023-09-01 21:01:29 +08:00
zqt ab4c8d2e5d Merge remote-tracking branch 'origin/dev' into dev 2023-09-01 18:10:32 +08:00
zqt 9b664d5eb2 添加例子例子"openai_proxy": 'http://127.0.0.1:4780' 2023-09-01 18:09:59 +08:00
liunux4odoo 1db8a07765
Merge branch 'chatchat-space:dev' into dev 2023-09-01 14:37:32 +08:00
imClumsyPanda d6dce95682 bug fix 2023-09-01 14:15:13 +08:00