weiweiw
/
Langchain-Chatchat
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,312 Commits 1 Branch 0 Tags 72 MiB
Commit Graph

61 Commits

Author SHA1 Message Date
imClumsyPanda a87a2815da update knowledge_base and dialogue page of webui 2023-09-15 13:45:47 +08:00
imClumsyPanda 20eef45a58 update README.md 2023-09-15 09:53:58 +08:00
liunux4odoo 30aeec1c45
修改智谱API默认名称，给WEBUI设置主题 (#1484) 
* 給WEBUI设置主题

* chatglm-api更名为zhipu-api
 2023-09-15 01:48:02 +08:00
liunux4odoo f0f1dc2537 补充更多千帆平台支持的模型；除了指定模型名称，支持直接指定模型APIURL，便于填写单独申请的模型地址 2023-09-15 00:30:18 +08:00
liunux4odoo 4cf2e5ea5e 修复文心一言，添加测试用例 2023-09-14 23:37:34 +08:00
imClumsyPanda 1813814a65 update model_config.py.example 2023-09-14 22:29:49 +08:00
imClumsyPanda 4c61a642cf update model_config.py.example 2023-09-14 22:29:26 +08:00
imClumsyPanda bda1b01a2d update model_config.py.example 2023-09-14 22:27:57 +08:00
imClumsyPanda 883445e5b2
增加 百度文心一言 API 接入支持 (#1477) 
* add RapidOCRPDFLoader

* update mypdfloader.py and requirements.txt

* add myimgloader.py

* add test samples

* add TODO to mypdfloader

* add loaders to KnowledgeFile class

* add loaders to KnowledgeFile class

* add ChineseRecursiveTextSplitter

* add ChineseRecursiveTextSplitter

* add baidu ernie api
 2023-09-14 15:30:06 +08:00
zR 769d75d784
修复测试文件 (#1467) 
Co-authored-by: zR <zRzRzRzRzRzRzR>
 2023-09-13 17:12:05 +08:00
zR bfdbe69fa1
增加了自定义分词器适配 (#1462) 
* 添加了自定义分词器适配和测试文件
---------

Co-authored-by: zR <zRzRzRzRzRzRzR>
 2023-09-13 15:42:12 +08:00
liunux4odoo 512638a3b1
支持讯飞星火大模型在线API (#1460) 
* 支持讯飞星火大模型在线API
 2023-09-13 13:51:05 +08:00
liunux4odoo 16d8809c9a
api和webui知识库操作支持chunk_size/overlap_size/zh_title_enhance参数 (#1459) 2023-09-13 11:19:47 +08:00
liunux4odoo 03c021d50f
添加MiniMax在线API支持 (#1445) 2023-09-12 15:24:47 +08:00
glide-the 5550e3c1a9 增加显示详细日志开关 2023-09-08 20:48:31 +08:00
imClumsyPanda 6ea4fc7a30 Merge branch 'master' into dev 2023-09-06 21:19:59 +08:00
imClumsyPanda 54cf79f521 add support for new embedding models sensenova/piccolo-base-zh and sensenova/piccolo-large-zh 2023-09-06 21:17:32 +08:00
imClumsyPanda 74cca5eb0e add support for shibing624/text2vec-bge-large-chinese 2023-09-05 18:19:13 +08:00
imClumsyPanda 780c1457d0 add support for shibing624/text2vec-bge-large-chinese 2023-09-05 18:04:21 +08:00
glide-the 0b60a25f2a 知识库默认存储路径 默认自动创建 2023-09-05 17:27:43 +08:00
imClumsyPanda 15619a1270 update model_config.py.example 2023-09-05 08:59:06 +08:00
imClumsyPanda 9855bc6f55 update model_config.py.example 2023-09-03 15:52:17 +08:00
imClumsyPanda 3391155077 update model_config.py.example 2023-09-02 15:33:57 +08:00
liunux4odoo 6cb1bdf623
添加切换模型功能，支持智谱AI在线模型 (#1342) 
* 添加LLM模型切换功能，需要在server_config中设置可切换的模型
* add tests for api.py/llm_model/*
* - 支持模型切换
- 支持智普AI线上模型
- startup.py增加参数`--api-worker`，自动运行所有的线上API模型。使用`-a
  (--all-webui), --all-api`时默认开启该选项
* 修复被fastchat覆盖的标准输出
* 对fastchat日志进行更细致的控制，startup.py中增加-q(--quiet)开关，可以减少无用的fastchat日志输出
* 修正chatglm api的对话模板


Co-authored-by: liunux4odoo <liunu@qq.com>
 2023-09-01 23:58:09 +08:00
zqt ab4c8d2e5d Merge remote-tracking branch 'origin/dev' into dev 2023-09-01 18:10:32 +08:00
zqt 9b664d5eb2 添加例子例子"openai_proxy": 'http://127.0.0.1:4780' 2023-09-01 18:09:59 +08:00
liunux4odoo b1201a5f23
优化LLM和Embedding模型运行设备配置，可设为auto自动检测；修复：重建知识库时FAISS未保存 (#1330) 
* 避免configs对torch的依赖；
* webui自动从configs获取api地址(close #1319)
* bug fix: 重建知识库时FAISS未保存
* 优化LLM和Embedding模型运行设备配置，可设为auto自动检测
 2023-08-31 17:44:48 +08:00
liunux4odoo 26a9237237
避免configs对torch的依赖；webui自动从configs获取api地址(close #1319) (#1328) 2023-08-31 16:18:12 +08:00
liunux4odoo 34a416b941
优化server_config配置项 (#1293) 
* update server_config.py:
- 在model_config中增加HISTORY_LEN配置参数
- 将server_config中helper function移动到server.utils中
- 统一set_httpx_timeout的定义和调用

* update webui.py:
应用model_config中的配置项：HISTORY_LEN,VECTOR_SEARCH_TOP_K,SEARCH_ENGINE_TOP_K

---------

Co-authored-by: liunux4odoo <liunu@qq.com>
 2023-08-29 10:06:09 +08:00
liunux4odoo 6ef8844b2b
修复使用chatgpt等在线API服务时模型加载错误 (#1271) 
* close #1172: 给webui_page/utils添加一些log信息，方便定位错误

* 修复：重建知识库时页面未实时显示进度

* skip model_worker running when using online model api such as chatgpt

---------

Co-authored-by: liunux4odoo <liunu@qq.com>
 2023-08-27 16:46:59 +08:00
zqt ea4b5ebd16 Merge branch 'master' into dev 2023-08-24 14:16:21 +08:00
zqt 37454db3ec 添加chatgpt 调用代理设置 2023-08-24 13:51:17 +08:00
imClumsyPanda 3504cb5274 update model_config.py.example 2023-08-23 23:04:13 +08:00
zR 7291e77978
support for bge-large-zh-noinstruct and openai text-embedding-ada-002 (#1119) 
* support for bge-large-zh-noinstruct and openai text-embedding-ada-002

* 完善了readme,修改了BGE模型的载入方式

* 补充了readme中bge-large-zh-noinstruct的信息

* Update faiss_kb_service.py

* Update utils.py

---------

Co-authored-by: zR <zRzRzRzRzRzRzR>
Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-08-23 22:55:53 +08:00
imClumsyPanda 4bcc74d214 update prompt template 2023-08-23 21:52:12 +08:00
liunux4odoo 44edce6bcf fix #1142: 在History中使用jinja2模板代替f-string，避免消息中含有{ }时出错 2023-08-23 08:35:26 +08:00
zqt b3450bfc96 添加milvus 和 pg QA说明 2023-08-20 18:03:23 +08:00
imClumsyPanda 7f7238168c reformat model_config.py.example 2023-08-17 21:31:30 +08:00
liunux4odoo f92b002342 add startup.py: start specified servers with one command. see python startup.py --help 2023-08-17 13:24:53 +08:00
hzg0601 1a40d464be 更新model_config.py.example: 更改所有模型的默认端口为8888 2023-08-16 22:26:18 +08:00
imClumsyPanda f7c82c13da update model_config.py.example 2023-08-14 19:17:34 +08:00
imClumsyPanda afc6aa968d update webui layout 2023-08-11 23:40:41 +08:00
liunux4odoo a261fda20b add tools to migrate knowledge base 2023-08-11 08:33:05 +08:00
liunux4odoo 17ddee38a4 fix conflict between def_fastchat and pr1037 2023-08-10 15:02:41 +08:00
zqt d4f728dfa2 添加向量数据库pg支持，和向量库docker-compose.ym环境文件 2023-08-10 11:16:52 +08:00
imClumsyPanda 8df00d0b04 add SCORE_THRESHOLD to faiss and milvus kb service 2023-08-10 00:36:59 +08:00
imClumsyPanda d67e354276 update model_config.py.example and README.md 2023-08-09 23:45:27 +08:00
imClumsyPanda dd26f552db update model_config.py.example 2023-08-09 23:39:05 +08:00
hzg0601 be7d31416c update model_config.py.example 2023-08-09 23:24:17 +08:00
imClumsyPanda 24a280ce8c re-add zh_title_enhance.py 2023-08-09 23:09:24 +08:00