weiweiw
/
Langchain-Chatchat
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,752 Commits 1 Branch 0 Tags 72 MiB
Commit Graph

128 Commits

Author SHA1 Message Date
hzg0601 89aed8e675 update readme_en,readme,requirements_api,requirements,model_config.py.example:测试baichuan2-7b;更新相关文档 2023-09-22 14:30:28 +08:00
Leego 9bcce0a572
【功能新增】在线 LLM 模型支持阿里云通义千问 (#1534) 
* feat: add qwen-api

* 使Qwen API支持temperature参数；添加测试用例

* 将online-api的sdk列为可选依赖

---------

Co-authored-by: liunux4odoo <liunux@qq.com>
 2023-09-20 21:34:12 +08:00
liunux4odoo b161985d79 fix #1519: streamlit-chatbox旧版BUG，但新版有兼容问题，先在webui中作处理，并限定chatbox版本 (#1525) 
close #1519
 2023-09-20 16:47:07 +08:00
imClumsyPanda fbaca1009e update requirements.txt, requirements_api.txt, test_different_splitter.py and chinese_recursive_text_splitter.py 2023-09-14 22:59:05 +08:00
liunux4odoo c4cb4e19e5
清理不必要的依赖，增加星火API需要的websockets (#1463) 2023-09-13 15:35:04 +08:00
liunux4odoo a03b8d330d
升级到langchain==0.0.287,fschat==0.0.28;处理langchain.Milvus bug(#10492) (#1454) 
* 修复milvus_kb_service中一些bug，添加文档后将数据同步到数据库
* 升级到langchain==0.0.287,fschat==0.0.28;处理langchain.Milvus bug(#10492)
* 修复切换模型BUG: 从在线API切换模型时出错
 2023-09-13 08:43:11 +08:00
glide-the b0a9d8f30e 增加显示ocr识别进度 2023-09-08 21:32:41 +08:00
imClumsyPanda 673410ecd5 fix pdf ocr bug 2023-09-06 20:08:56 +08:00
imClumsyPanda 9da7313e7e update requirements.txt 2023-09-05 14:46:26 +08:00
imClumsyPanda 220b1bd9ae update requirements.txt 2023-09-05 13:41:08 +08:00
imClumsyPanda 6c4ef26e9a
add RapidOCRPDFLoader and RapidOCRLoader (#1275) 
* add RapidOCRPDFLoader

* update mypdfloader.py and requirements.txt

* add myimgloader.py

* add test samples

* add TODO to mypdfloader

* add loaders to KnowledgeFile class

* add loaders to KnowledgeFile class
 2023-09-01 10:23:57 +08:00
imClumsyPanda 37985f29f0
Update requirements.txt 2023-08-26 13:35:47 +08:00
imClumsyPanda 32bf508745 update requirements 2023-08-25 22:53:49 +08:00
imClumsyPanda 2e930cf43c update requirements.txt 2023-08-25 22:14:56 +08:00
imClumsyPanda fd5988422e update langchain version requirements 2023-08-20 16:52:56 +08:00
liunux4odoo 8ed1f8efca update fastchat to 0.2.24 2023-08-16 16:15:45 +08:00
liunux4odoo f64affc930 update llm_api and api server: 
1. fastchat's controller/model_worker/api_server use swagger UI offline.
2. add custom title and icon.
3. remove fastapi-offline dependence
 2023-08-16 14:20:09 +08:00
imClumsyPanda 353d9fc72b update init_database.py 2023-08-13 10:25:02 +08:00
imClumsyPanda e65458a506 update requirements.txt 2023-08-12 10:44:04 +08:00
liunux4odoo 2a57f49d80 update knowledge base management ui. 
remove numpy/pandas from requirements, move them to webui requirements
 2023-08-11 13:53:20 +08:00
imClumsyPanda 9fc467274f update requirements.txt 2023-08-10 21:53:09 +08:00
imClumsyPanda 8a4d9168fa update import pkgs and format 2023-08-10 21:26:05 +08:00
liunux4odoo b733a47902 split requirements to 2 parts: basic with api; webui 2023-08-10 15:51:22 +08:00
zqt d4f728dfa2 添加向量数据库pg支持，和向量库docker-compose.ym环境文件 2023-08-10 11:16:52 +08:00
liunux4odoo 53fef3a7e9 add streamlit-aggrid to requirements 2023-08-10 07:50:24 +08:00
imClumsyPanda 2d49746a8d add history to chat apis 2023-08-08 23:54:51 +08:00
zqt 79be21521a 补充SQLAlchemy==2.0.19版本 2023-08-08 14:29:08 +08:00
liunux4odoo 40b6d1f178 add python-magic-bin to requirements on windows. or document loader failed at `from unstructured.partion.auto import partion` on windows 2023-08-08 12:03:33 +08:00
liunux4odoo 44c713ef98 use KBServiceFactory to replace all the KnowledgeBase. 
make KBServiceFactory support embed_model parameter.
rewrite api: recreate_vector_store.
fix some bugs.
 2023-08-07 20:37:16 +08:00
imClumsyPanda 7bfbe18011 update requirements.txt and kb_doc_api.py 2023-08-04 15:12:14 +08:00
liunux4odoo 3318cef751 update streamlit ui: support latest knowledge base and search engine 
chat api; export messages to markdown.
 2023-08-04 12:52:58 +08:00
imClumsyPanda 82aa805bf3 update requirements.txt 2023-08-03 23:42:55 +08:00
liunux4odoo 2c5b6bb0ad streamlit ui 实现LLM流式对话 2023-08-01 14:18:30 +08:00
liunux4odoo 463659f0ba llm_api升级到fschat==0.2.20，支持百川模型 2023-07-30 23:16:47 +08:00
imClumsyPanda 41444fd4b5 update requirements.txt and llm_api.py 2023-07-30 00:24:34 +08:00
imClumsyPanda d4ffc70d96 update requirements.txt 2023-07-29 23:46:02 +08:00
imClumsyPanda e95996a9b9 update requirements.txt 2023-07-28 06:59:16 +08:00
imClumsyPanda dcf49a59ef v0.2.0 first commit 2023-07-27 23:22:07 +08:00
imClumsyPanda 1ef3ef5d27 update gradio version in requirements.txt 2023-07-18 04:03:28 +08:00
Zhi-guo Huang a5ca4bf26a
1.增加对llama-cpp模型的支持；2.增加对bloom/chatyuan/baichuan模型的支持；3. 修复多GPU部署的bug;4. 修复了moss_llm.py的bug；5. 增加对openai支持（没有api,未测试);6. 支持在多卡情况自定义设备GPU (#664) 
* 修复 bing_search.py的typo;更新model_config.py中Bing Subscription Key申请方式及注意事项

* 更新FAQ，增加了[Errno 110] Connection timed out的原因与解决方案

* 修改loader.py中load_in_8bit失败的原因和详细解决方案

* update loader.py

* stream_chat_bing

* 修改stream_chat的接口，在请求体中选择knowledge_base_id;增加stream_chat_bing接口

* 优化cli_demo.py的逻辑：支持 输入提示；多输入；重新输入

* update cli_demo.py

* add bloom-3b,bloom-7b1,ggml-vicuna-13b-1.1

* 1.增加对llama-cpp模型的支持；2.增加对bloom模型的支持；3. 修复多GPU部署的bug;4. 增加对openai支持（没有api,未测试)；5.增加了llama-cpp模型部署的说明

* llama模型兼容性说明

* modified:   ../configs/model_config.py
	modified:   ../docs/INSTALL.md
在install.md里增加对llama-cpp模型调用的说明

* 修改llama_llm.py以适应llama-cpp模型

* 完成llama-cpp模型的支持；

* make fastchat and openapi compatiable

* 1. 修复/增加对chatyuan,bloom,baichuan-7等模型的支持；2. 修复了moss_llm.py的bug;

* set default model be chatglm-6b

* 在多卡情况下也支持自定义GPU设备

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-07-11 19:36:50 +08:00
imClumsyPanda f6218316e3 update requirements.txt and model_config.py 2023-06-18 21:52:49 +08:00
Zhi-guo Huang 27a9bf2433
更新FAQ和requirements,解决upload_file接口的两个异常 (#593) 2023-06-11 21:25:02 +08:00
imClumsyPanda 23052629ad update requirements.txt 2023-05-31 22:31:54 +08:00
glide-the 561c40afee Merge remote-tracking branch 'origin/dev' into dev 2023-05-26 22:32:25 +08:00
glide-the 994401670b 拓展功能检查依赖提示安装 2023-05-26 22:32:12 +08:00
keenzhu 11bcb58ae6 增加rss订阅，以及添加了依赖文件 2023-05-26 18:50:20 +08:00
keenzhu 9dc9ac6380 添加依赖feedparser 2023-05-26 18:46:18 +08:00
imClumsyPanda 1ee12266e8 更新 requirements.txt 2023-05-24 00:12:59 +08:00
imClumsyPanda 5f38645fa1 update api.py 2023-05-21 22:27:02 +08:00
imClumsyPanda 94b4599cda update requirements.txt 2023-05-20 01:58:08 +08:00
glide-the 33bbb4779e llm_model_dict 处理了loader的一些预设行为，如加载位置，模型名称，模型处理器实例, 定义checkpoint名称和远程路径 
loader.py: 模型重载
定义 generatorAnswer 增加 AnswerResultStream
   定义generate_with_callback收集器，在每次响应时将队列数据同步到AnswerResult
requirements.txt 变更项目依赖
 2023-05-18 22:54:41 +08:00
CHANGXUBO cb8466900f
Fix MOSS模型BUG (#389) 2023-05-17 13:44:39 +08:00
zqt996 a0cb14de23
添加命令行管理脚本 (#355) 
* 添加加命令行工具

* 添加加命令行工具

---------

Co-authored-by: zqt <1178747941@qq.com>
Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-05-15 19:13:12 +08:00
imClumsyPanda 31121945fc update requirements.txt 2023-05-14 00:36:42 +08:00
zhenkaivip dd93837343
使用paddleocr实现 (#342) 
* jpg and png ocr

* fix

* write docs to tmp file

* fix

* [BUGFIX] local_doc_qa.py line 172: logging have no end args. (#323)

* image loader

* fix

* fix

* update api.py

* update api.py

* update api.py

* update README.md

* update api.py

* add pdf_loader

* fix

---------

Co-authored-by: RainGather <3255329+RainGather@users.noreply.github.com>
Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-05-13 08:45:17 +08:00
Tyler Luan 64406cee45
Add MOSS (#317) 
* Add MOSS

* Update local_doc_qa.py

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-05-11 18:42:19 +08:00
imClumsyPanda c613c41d0e update local_doc_qa.py 2023-05-08 23:49:57 +08:00
CHANGXUBO 3111fb56bd
Fix: 将gradio版本升级至3.28.3，修复知识库下拉框change事件获取值不是当前选中值的bug。 (#261) 
* webui优化：解决每次页面刷新后都需要重新选择知识库的问题，增加Flagging收集问答效果。

* Fix: 将gradio版本升级至3.28.3，修复知识库下拉框change事件获取值不是当前选中值的bug。

* solve webui confict

---------

Co-authored-by: Bob Chang <bob.chang@amway.com>
Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-05-06 21:38:15 +08:00
shrimp 14d998b8e6
可选择lora权重加载 (#231) 
* Add files via upload

增加lora权重使用

* Update model_config.py

* Add files via upload

修复一个小错误，少写了模型加载

* 使用lora微调的权重

使用lora微调的权重

* Update model_config.py
 2023-05-04 21:01:55 +08:00
Bing Han e0cf26019b
Use fastapi to implement API (#209) 
* Use fastapi to implement API

* Update model_config.py

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-05-03 21:29:28 +08:00
imClumsyPanda 474e3414c5 update README.md 2023-04-28 19:11:26 +08:00
EvanGu 8b4ae5a6b3
Update requirements.txt (#158) 
add  accelerate、pycocotools

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-04-23 19:52:29 +08:00
imClumsyPanda 85f02224e4 update requirements.txt 2023-04-23 19:43:59 +08:00
imClumsyPanda 0706a29057 update embedding define in local_doc_qa.py and langchain version in requirements.txt 2023-04-22 12:30:27 +08:00
imClumsyPanda 7b3e782023 update cli_demo.py 2023-04-14 01:06:13 +08:00
imClumsyPanda e05d4a90ca update cli_demo.py 2023-04-14 00:09:29 +08:00
imClumsyPanda 8638aa98ba update requirements.txt and add pdf_requirements.txt 2023-04-13 18:30:00 +08:00
imClumsyPanda 1a6289b630 update requirements.txt 2023-04-12 20:57:24 +08:00
imClumsyPanda cf2aa21446 update webui.py and README.md 2023-04-11 19:52:59 +08:00
imClumsyPanda f7f40406c4 update requirements.txt 2023-04-11 11:09:38 +08:00
imClumsyPanda 7e3b87dcd6 update requirements.txt 2023-04-08 09:23:58 +08:00
thomas-yanxin b6e603a33c
Update requirements.txt 2023-04-05 21:39:42 +08:00
littlepanda0716 1851b4f074 update requirements.txt 2023-04-03 21:07:41 +08:00
littlepanda0716 a8abbff4bb update requirements.txt 2023-04-03 20:37:54 +08:00
littlepanda0716 6762ab442f update function name and requirements.txt 2023-04-03 19:15:08 +08:00
zx2021 7d59541718
Update requirements.txt 
修复了运行pip install -r requirements.txt提示ERROR: Invalid requirement: '"detectron2@git+https://github.com/facebookresearch/detectron2.git@v0.6#egg=detectron2"' (from line 4 of requirements.txt)
Hint: = is not a valid operator. Did you mean == ?的错误
 2023-03-31 21:49:16 +08:00
zx2021 2d3ea9830e
Update requirements.txt 
修复运行pip install -r requirements.txt提示ERROR: Invalid requirement: '"detectron2@git+https://github.com/facebookresearch/detectron2.git@v0.6#egg=detectron2"' (from line 4 of requirements.txt)
Hint: = is not a valid operator. Did you mean == ?的错误
 2023-03-31 21:47:58 +08:00
littlepanda0716 f17d26addf first commit 2023-03-31 20:09:40 +08:00