Commit Graph

41 Commits

Author SHA1 Message Date
imClumsyPanda 20f1daff1a add fastchat.md 2023-05-31 22:50:35 +08:00
glide-the ab73f6ad93 适配远程LLM调用 2023-05-31 22:26:39 +08:00
glide-the 24324563d6 适配远程LLM调用 2023-05-31 22:11:28 +08:00
glide-the 0f2ea29194 调整项目结构,适配远程LLM调用生成问题。新增fastchat_openai_llm.py实现fastchat openai报文报文形式调用 2023-05-31 00:00:35 +08:00
liunux4odoo 88fee48d8c
use lru_cache to optimize loading of local vector store (#496)
* Add files via upload

* Update README.md

* use lru_cache to optimize loading of local vector store

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
Co-authored-by: liunux <liunux@office>
2023-05-30 23:05:39 +08:00
glide-the a1b1b78108 使用model_config默认配置启动
llama_llm.py 删除流式输出
base.py、shared.py 删除多余代码
fastchat_llm.py 业务实现
2023-05-23 23:10:31 +08:00
imClumsyPanda d2983e935f update loaders 2023-05-22 00:15:29 +08:00
imClumsyPanda 483b7dd291 update model_config.py 2023-05-21 22:41:22 +08:00
imClumsyPanda 67e26fe730 update model_config.py 2023-05-21 22:30:28 +08:00
imClumsyPanda 49e47231af update model_config.py 2023-05-19 23:16:39 +08:00
imClumsyPanda 7d837078e7 update model_config.py 2023-05-19 23:12:39 +08:00
glide-the 75cf9f9b4e ptuning-v2配置 2023-05-18 23:19:23 +08:00
glide-the 33bbb4779e llm_model_dict 处理了loader的一些预设行为,如加载位置,模型名称,模型处理器实例, 定义checkpoint名称和远程路径
loader.py: 模型重载
定义 generatorAnswer 增加 AnswerResultStream
   定义generate_with_callback收集器,在每次响应时将队列数据同步到AnswerResult
requirements.txt 变更项目依赖
2023-05-18 22:54:41 +08:00
Tyler Luan 64406cee45
Add MOSS (#317)
* Add MOSS

* Update local_doc_qa.py

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
2023-05-11 18:42:19 +08:00
akou 2987c9cd52
增加允许跨域调用API功能 (#279) 2023-05-11 09:32:58 +08:00
imClumsyPanda f403ad755c update README.md 2023-05-11 00:09:38 +08:00
imClumsyPanda 264981e4b6 update webui.py 2023-05-10 23:21:36 +08:00
shrimp 55504fcd4d
新增加知识库测试能力 (#302) 2023-05-10 17:18:20 +08:00
CHANGXUBO 47e9bdb122
logging: 格式日志输出 (#268)
* logging: 统一日志格式输出

---------

Co-authored-by: Bob Chang <bob.chang@amway.com>
Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
2023-05-08 18:29:09 +08:00
imClumsyPanda e2d7452c7b update chinese_text_splitter.py 2023-05-06 23:26:49 +08:00
shrimp 7497b261b3
完善知识库路径问题,完善api接口 (#245)
* Fix 知识库无法上载,NLTK_DATA_PATH路径错误 (#236)

* Update chatglm_llm.py (#242)

* 完善知识库路径问题,完善api接口

统一webui、API接口知识库路径,后续路径如下:
知识库路经就是:/项目代码文件夹/vector_store/'知识库名字'
文件存放路经:/项目代码文件夹/content/'知识库名字'

修复通过api接口创建知识库的BUG,完善API接口功能。

* Update model_config.py

---------

Co-authored-by: Bob Chang <bob-chang@outlook.com>
Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
2023-05-05 18:44:37 +08:00
shrimp 14d998b8e6
可选择lora权重加载 (#231)
* Add files via upload

增加lora权重使用

* Update model_config.py

* Add files via upload

修复一个小错误,少写了模型加载

* 使用lora微调的权重

使用lora微调的权重

* Update model_config.py
2023-05-04 21:01:55 +08:00
imClumsyPanda 07ff81a119 update torch_gc 2023-05-04 20:48:36 +08:00
imClumsyPanda 2c1fd2bdd5 add api.py 2023-05-03 22:31:28 +08:00
Bing Han e0cf26019b
Use fastapi to implement API (#209)
* Use fastapi to implement API

* Update model_config.py

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
2023-05-03 21:29:28 +08:00
imClumsyPanda c98c4888e9 update PROMPT_TEMPLATE 2023-05-02 00:28:09 +08:00
imClumsyPanda 7a406e4263
Dev (#214)
* github: Add issue templates

* supports GPU usage in docker (#197)

* 上下文的prompt模版内容修改

---------

Co-authored-by: Calcitem <calcitem@outlook.com>
Co-authored-by: cocomany <124849750+cocomany@users.noreply.github.com>
Co-authored-by: glide-the <2533736852@qq.com>
2023-05-01 23:55:37 +08:00
imClumsyPanda 0e8cc0d16c add streaming option in configs/model_config.py 2023-05-01 23:52:28 +08:00
imClumsyPanda 98a8281b29 update text_splitter 2023-04-28 00:02:42 +08:00
imClumsyPanda cae2427e1e add llm model and embedding model options in model_config.py 2023-04-27 07:48:43 +08:00
imClumsyPanda 4dc762849b update model_config.py 2023-04-27 07:40:57 +08:00
imClumsyPanda c620ab0d6c update model_config.py 2023-04-26 23:27:15 +08:00
imClumsyPanda b3f83060c8 update model_config.py 2023-04-26 23:27:15 +08:00
imClumsyPanda b48e399e9e Update model_config.py 2023-04-21 21:27:20 +08:00
soon 37ceeae6e2 提交更 2023-04-21 21:27:20 +08:00
imClumsyPanda 13b41553a3 update project to v0.1.3 2023-04-19 23:02:47 +08:00
imClumsyPanda 811d5a2e46
Update model_config.py 2023-04-18 19:45:50 +08:00
wangxinkai 3eaa25c9ba feat: add api for knowledge_based QA 2023-04-18 10:08:13 +08:00
Thaumstrial 2cd52f6605 Support p-tuning-v2 2023-04-15 14:43:12 +08:00
imClumsyPanda eabef0415b update cli_demo.py 2023-04-13 23:20:45 +08:00
imClumsyPanda a6184b01be 修改项目架构 2023-04-13 23:01:52 +08:00