Commit Graph

784 Commits

Author SHA1 Message Date
Zhi-guo Huang a5ca4bf26a
1.增加对llama-cpp模型的支持;2.增加对bloom/chatyuan/baichuan模型的支持;3. 修复多GPU部署的bug;4. 修复了moss_llm.py的bug;5. 增加对openai支持(没有api,未测试);6. 支持在多卡情况自定义设备GPU (#664)
* 修复 bing_search.py的typo;更新model_config.py中Bing Subscription Key申请方式及注意事项

* 更新FAQ,增加了[Errno 110] Connection timed out的原因与解决方案

* 修改loader.py中load_in_8bit失败的原因和详细解决方案

* update loader.py

* stream_chat_bing

* 修改stream_chat的接口,在请求体中选择knowledge_base_id;增加stream_chat_bing接口

* 优化cli_demo.py的逻辑:支持 输入提示;多输入;重新输入

* update cli_demo.py

* add bloom-3b,bloom-7b1,ggml-vicuna-13b-1.1

* 1.增加对llama-cpp模型的支持;2.增加对bloom模型的支持;3. 修复多GPU部署的bug;4. 增加对openai支持(没有api,未测试);5.增加了llama-cpp模型部署的说明

* llama模型兼容性说明

* modified:   ../configs/model_config.py
	modified:   ../docs/INSTALL.md
在install.md里增加对llama-cpp模型调用的说明

* 修改llama_llm.py以适应llama-cpp模型

* 完成llama-cpp模型的支持;

* make fastchat and openapi compatiable

* 1. 修复/增加对chatyuan,bloom,baichuan-7等模型的支持;2. 修复了moss_llm.py的bug;

* set default model be chatglm-6b

* 在多卡情况下也支持自定义GPU设备

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
2023-07-11 19:36:50 +08:00
kztao cf0f1d6625
Update README.md, 0.1.16版本已经支持删除知识库中的文件 (#792)
* Update README.md

* fix:The knowledge base name cannot be empty.

* Update webui.py

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
2023-07-11 19:20:47 +08:00
kztao c564c91a82
fix:The knowledge base name cannot be empty. (#793)
* fix:The knowledge base name cannot be empty.

* Update webui.py

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
2023-07-11 19:18:24 +08:00
imClumsyPanda 80af725a41
Update README.md 2023-07-11 19:15:09 +08:00
imClumsyPanda f0ea1c1bb0
Add files via upload 2023-07-11 19:14:41 +08:00
ysyx2008 5f0697799a
解决 image_loader.py 运行时报错“ModuleNotFoundError: No module named 'configs'”的问题。 (#795) 2023-07-11 19:12:46 +08:00
imClumsyPanda a8a3ea9ca2
Update README.md 2023-07-07 10:27:00 +08:00
imClumsyPanda af4ddc8923
Add files via upload 2023-07-07 10:26:23 +08:00
hzg0601 300d287d61 修改默认的多卡部署方案,基本保证针对新模型也不会失败 2023-07-06 04:47:44 +08:00
imClumsyPanda e68bc53cab
Update README.md 2023-07-05 09:32:40 +08:00
imClumsyPanda de98919fe6
Add files via upload 2023-07-05 09:32:05 +08:00
Fan 10abb8d781
添加启动API的参数,支持https、wss方式API调用 (#728)
* update README.md

* 添加启动API的参数,支持https、wss方式API调用。(CA证书自备)
添加启动API服务的markdown说明文档。

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
Co-authored-by: 一帆 <zhang.f@digitalcnzz.com>
2023-07-04 19:52:17 +08:00
stc2001 7217e3391d
Update model_config.py (#768)
添加ChatGLM2-6b-int4和ChatGLM2-6b-int8
2023-07-04 19:04:57 +08:00
imClumsyPanda 967ac2ed2b merge master 2023-07-02 22:18:59 +08:00
imClumsyPanda 80ecc08044 update README.md 2023-07-02 22:16:58 +08:00
Zhi-guo Huang c52308d605
1. 修改stream_chat的接口,在请求体中选择knowledge_base_id;2. 增加stream_chat_bing接口;3. 增加了调用流式接口的方法说明;4. 优化cli_demo.py的逻辑:支持 输入提示;多输入;重新输入 (#630)
* 修复 bing_search.py的typo;更新model_config.py中Bing Subscription Key申请方式及注意事项

* 更新FAQ,增加了[Errno 110] Connection timed out的原因与解决方案

* 修改loader.py中load_in_8bit失败的原因和详细解决方案

* update loader.py

* stream_chat_bing

* 修改stream_chat的接口,在请求体中选择knowledge_base_id;增加stream_chat_bing接口

* 优化cli_demo.py的逻辑:支持 输入提示;多输入;重新输入

* update cli_demo.py

* 按照review建议进行修改
2023-07-02 21:54:12 +08:00
hzg0601 43fae98bb5 按照review建议进行修改 2023-07-02 20:47:27 +08:00
zzxs 6ab496ea4a
Update api.py (#628)
修复websocket的伪流式输出
2023-07-02 13:42:53 +08:00
imClumsyPanda b922970ac2
Update README.md 2023-07-01 10:16:47 +08:00
imClumsyPanda 393bd400cb
Add files via upload 2023-07-01 10:16:09 +08:00
Jingsong-Yan 421ce3da3a
Add device_map config to support chatglm2-6b (#734)
chatglm-6b和chatglm2-6b的参数命名不一致,本次提交旨在解决chatglm2-6b device_map 创建的问题。在chatglm_auto_configure_device_map 函数中新增了chatglm2-6b device_map 创建的相关代码。
2023-06-30 21:08:38 +08:00
neverless00 51ed739d6c
fix 2 bugs on streamlit demo (#719) 2023-06-30 21:01:41 +08:00
jinke 3c66fc3b18
向Readme添加Docker整合包描述 (#746) 2023-06-30 07:19:07 +08:00
imClumsyPanda 1612c89160
Update README.md 2023-06-29 12:53:27 +08:00
imClumsyPanda 2bda2cf7a6
Update README.md 2023-06-29 12:52:51 +08:00
imClumsyPanda 46bd13d9db
Add files via upload 2023-06-29 12:50:52 +08:00
imClumsyPanda 1ec8f33db8
Update README.md 2023-06-27 16:13:15 +08:00
imClumsyPanda c69e63a442
Add files via upload 2023-06-27 16:11:45 +08:00
allseeeeeee 521d9e2f98
Dev streaming oom (#722) 2023-06-26 19:12:50 +08:00
imClumsyPanda d0b746c54f update README.md 2023-06-25 17:55:00 +08:00
imClumsyPanda 623d3d44ec Merge branch 'master' into dev 2023-06-25 17:05:05 +08:00
imClumsyPanda eaf46a04e3 Add chatglm2-6b configs 2023-06-25 17:04:16 +08:00
imClumsyPanda fc57d76c3c
Update README.md 2023-06-22 10:39:18 +08:00
imClumsyPanda bf87e791f3
Add files via upload 2023-06-22 10:38:54 +08:00
fxjhello 6195a5974a
Merge pull request #651 from sivdead/fix/kbs_interface_adjust
前端知识库相关接口报错修复
2023-06-20 19:01:48 +08:00
fxjhello 6e666237cd
Merge pull request #679 from hzhaoy/master
Fix #675: 解决因vue前端代码有误导致镜像构建失败的问题
2023-06-20 18:59:21 +08:00
Elwin 8d01bc9170
Merge branch 'imClumsyPanda:master' into master 2023-06-20 16:27:24 +08:00
hzhaoy 1a0eadccb2 Fix #675: 解决因vue前端代码有误导致镜像构建失败的问题 2023-06-20 15:54:11 +08:00
LuoQianhong 241e19a9af
Merge branch 'dev' into fix/kbs_interface_adjust 2023-06-20 09:18:14 +08:00
imClumsyPanda 7b4884a2db update README.md 2023-06-19 23:02:56 +08:00
TOMCAT 007 ef5bab1d92 错误操作撤销了#653,补充提交 2023-06-19 21:16:51 +08:00
imClumsyPanda 11c35722ba update QR Code 2023-06-19 20:51:18 +08:00
fengyunzaidushi d7d235463e
整理了下issue的问题,方便新手入门 (#669)
* Create ceshi

* Delete ceshi

* Create ceshi

* langchain-问题整理

下一步分类

* Delete ceshi
2023-06-19 19:33:11 +08:00
imClumsyPanda 017b34647e update requirements.txt and model_config.py 2023-06-18 21:52:56 +08:00
imClumsyPanda f6218316e3 update requirements.txt and model_config.py 2023-06-18 21:52:49 +08:00
kiddog99 25b46a7b9e
标题增强 (#631)
* Add files via upload

* Update local_doc_qa.py

* Update model_config.py

* Update zh_title_enhance.py

* Add files via upload

* Update README.md

* fix bugs in MyFAISS.delete_doc

* fix:前端知识库获取失败.

* update zh_title_enhance.py

* update zh_title_enhance.py

* Update zh_title_enhance.py

* add test/textsplitter

* add test_zh_title_enhance.py

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
Co-authored-by: JZF <jiangzhifeng_jzf@163.com>
Co-authored-by: fxjhello <127916299+fxjhello@users.noreply.github.com>
2023-06-18 21:45:06 +08:00
fxjhello 3f7e81585e
Merge pull request #657 from imClumsyPanda/revert-653-dev-1
Revert 653 dev 1
2023-06-17 20:30:04 +08:00
fxjhello 409a302f9b
Revert "fix:前端知识库获取失败. 修改获取及删除接口至knowledge_base" 2023-06-17 20:29:25 +08:00
fxjhello 6981bdee62
Merge pull request #653 from 1729457433/dev-1
fix:前端知识库获取失败. 修改获取及删除接口至knowledge_base
2023-06-17 20:29:17 +08:00
fxjhello 5eab13c911
Merge pull request #636 from hzhaoy/master
解决vue前端镜像构建失败的问题
2023-06-17 20:28:54 +08:00