weiweiw
/
Langchain-Chatchat
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
495 Commits 1 Branch 0 Tags 72 MiB
Commit Graph

59 Commits

Author SHA1 Message Date
glide-the 24324563d6 适配远程LLM调用 2023-05-31 22:11:28 +08:00
glide-the 0f2ea29194 调整项目结构,适配远程LLM调用生成问题。新增fastchat_openai_llm.py实现fastchat openai报文报文形式调用 2023-05-31 00:00:35 +08:00
glide-the 0a605bf4b5 调整项目结构 2023-05-30 20:40:27 +08:00
glide-the 3324c12d69 增加cpu加载模型逻辑 2023-05-26 22:52:55 +08:00
glide-the 994401670b 拓展功能检查依赖提示安装 2023-05-26 22:32:12 +08:00
glide-the 1c5f71beee Merge remote-tracking branch 'origin/dev' into dev 2023-05-26 01:49:26 +08:00
glide-the 25e5ab1282 增加call_行为 2023-05-26 01:46:59 +08:00
imClumsyPanda 3d33191bd7 update chatglm_llm.py 2023-05-25 23:04:53 +08:00
imClumsyPanda e4df46bcaa merge master 2023-05-25 22:57:51 +08:00
imClumsyPanda a1fd0b8750
Update chatglm_llm.py 2023-05-25 22:00:17 +08:00
glide-the c4ee36b8ac 删除 AnswerResultStream 、generate_with_callback收集器 2023-05-25 21:07:40 +08:00
glide-the e7b06a9072 删除流式请求中的缓存清理 2023-05-25 20:58:04 +08:00
imClumsyPanda 52c6f2d29f fix int4 and int8 model init bug 2023-05-24 00:20:03 +08:00
glide-the a1b1b78108 使用model_config默认配置启动 
llama_llm.py 删除流式输出
base.py、shared.py 删除多余代码
fastchat_llm.py 业务实现
 2023-05-23 23:10:31 +08:00
glide-the 6f8da56083
Update loader.py 
删除低显存加载参数
 2023-05-22 16:12:01 +08:00
imClumsyPanda e352a04cbb merge master 2023-05-22 00:18:48 +08:00
imClumsyPanda 12316d0658 update model_config.py 2023-05-21 22:40:53 +08:00
imClumsyPanda 871a871651 update model_loader 2023-05-21 15:30:52 +08:00
zhenkaivip 9f5d1afc31
fix bug : 1、历史最后一条丢失；2、上下两行连读造成歧义 (#415) 
* fix _call bug

* fix

* fix bug : 上下两行连读造成歧义
 2023-05-20 01:19:22 +08:00
imClumsyPanda d5ffdaa281 update loader.py 2023-05-20 00:06:41 +08:00
imClumsyPanda aa26645407 Merge remote-tracking branch 'origin/dev' into dev 2023-05-19 23:56:43 +08:00
imClumsyPanda 6c251bd2cf update callback.py 2023-05-19 23:56:36 +08:00
glide-the 65412e6cfb moss_llm.py 删除 stopping_criteria 2023-05-19 23:47:13 +08:00
imClumsyPanda ff7ac0333e update model_config.py 2023-05-19 23:45:01 +08:00
imClumsyPanda 09248391c2 Merge remote-tracking branch 'origin/dev' into dev 2023-05-19 23:42:00 +08:00
imClumsyPanda e057c88621 update model_config.py 2023-05-19 23:41:52 +08:00
glide-the 62ce5f0775 self.device_map 参数初始化逻辑 
LLamaLLM 加载器
 2023-05-19 23:38:36 +08:00
imClumsyPanda 7d837078e7 update model_config.py 2023-05-19 23:12:39 +08:00
imClumsyPanda 00d80335fe update loader.py 2023-05-19 22:55:19 +08:00
glide-the 5524c47645
Update moss_llm.py 2023-05-19 17:32:38 +08:00
glide-the 75cf9f9b4e ptuning-v2配置 2023-05-18 23:19:23 +08:00
glide-the 33bbb4779e llm_model_dict 处理了loader的一些预设行为，如加载位置，模型名称，模型处理器实例, 定义checkpoint名称和远程路径 
loader.py: 模型重载
定义 generatorAnswer 增加 AnswerResultStream
   定义generate_with_callback收集器，在每次响应时将队列数据同步到AnswerResult
requirements.txt 变更项目依赖
 2023-05-18 22:54:41 +08:00
Tyler Luan 64406cee45
Add MOSS (#317) 
* Add MOSS

* Update local_doc_qa.py

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-05-11 18:42:19 +08:00
RainGather b0714eed5e
Update chatglm_llm.py (#316) 2023-05-11 14:36:52 +08:00
Tyler Luan 8289338c47
Multi-gpu lora load bugfix (#312) 2023-05-11 11:32:17 +08:00
Tyler Luan 31655339f0
chatglm init twice (#313) 2023-05-11 11:31:15 +08:00
shrimp 55504fcd4d
新增加知识库测试能力 (#302) 2023-05-10 17:18:20 +08:00
JohnSaxon 466bfb7a3f
logger bug introduced by https://github.com/imClumsyPanda/langchain-ChatGLM/pull/268 , fixed #295 (#297) 2023-05-10 13:28:44 +08:00
CHANGXUBO 47e9bdb122
logging: 格式日志输出 (#268) 
* logging: 统一日志格式输出

---------

Co-authored-by: Bob Chang <bob.chang@amway.com>
Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-05-08 18:29:09 +08:00
shrimp 0d9db37f45
完善API接口，完善模型加载 (#247) 
* 完善知识库路径问题，完善api接口

统一webui、API接口知识库路径，后续路径如下：
知识库路经就是：/项目代码文件夹/vector_store/'知识库名字'
文件存放路经：/项目代码文件夹/content/'知识库名字'

修复通过api接口创建知识库的BUG，完善API接口功能。

* Update model_config.py


* 完善知识库路径问题，完善api接口 (#245) (#246)

* Fix 知识库无法上载,NLTK_DATA_PATH路径错误 (#236)

* Update chatglm_llm.py (#242)

* 完善知识库路径问题，完善api接口

统一webui、API接口知识库路径，后续路径如下：
知识库路经就是：/项目代码文件夹/vector_store/'知识库名字'
文件存放路经：/项目代码文件夹/content/'知识库名字'

修复通过api接口创建知识库的BUG，完善API接口功能。

* Update model_config.py

---------

Co-authored-by: shrimp <411161555@qq.com>
Co-authored-by: Bob Chang <bob-chang@outlook.com>

* 优化API接口，完善模型top_p参数

优化API接口，知识库非必须选项。
完善模型top_p参数

* 完善API接口，完善模型加载

API接口知识库非必须加载项
完善模型top_p参数。

---------

Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
Co-authored-by: Bob Chang <bob-chang@outlook.com>
 2023-05-05 22:31:41 +08:00
shrimp 7497b261b3
完善知识库路径问题，完善api接口 (#245) 
* Fix 知识库无法上载,NLTK_DATA_PATH路径错误 (#236)

* Update chatglm_llm.py (#242)

* 完善知识库路径问题，完善api接口

统一webui、API接口知识库路径，后续路径如下：
知识库路经就是：/项目代码文件夹/vector_store/'知识库名字'
文件存放路经：/项目代码文件夹/content/'知识库名字'

修复通过api接口创建知识库的BUG，完善API接口功能。

* Update model_config.py

---------

Co-authored-by: Bob Chang <bob-chang@outlook.com>
Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
 2023-05-05 18:44:37 +08:00
shrimp 14d998b8e6
可选择lora权重加载 (#231) 
* Add files via upload

增加lora权重使用

* Update model_config.py

* Add files via upload

修复一个小错误，少写了模型加载

* 使用lora微调的权重

使用lora微调的权重

* Update model_config.py
 2023-05-04 21:01:55 +08:00
imClumsyPanda 07ff81a119 update torch_gc 2023-05-04 20:48:36 +08:00
imClumsyPanda 57d4d0a29e update chatglm_llm.py 2023-05-03 11:29:59 +08:00
imClumsyPanda 4df9d76f8a add streaming option in configs/model_config.py 2023-05-01 23:52:28 +08:00
imClumsyPanda 966def8cfe add stream support to webui.py 2023-04-26 23:27:15 +08:00
imClumsyPanda b4aefca555 add stream support to cli_demo.py 2023-04-26 23:27:15 +08:00
imClumsyPanda 88ab9a1d21 update webui.py and local_doc_qa.py 2023-04-26 23:27:15 +08:00
imClumsyPanda 3b4b660d3c update chatglm_llm.py 2023-04-26 23:27:15 +08:00
imClumsyPanda 59aff96add update chatglm_llm.py 2023-04-22 21:20:18 +08:00