Commit Graph

75 Commits

Author SHA1 Message Date
imClumsyPanda 2d49746a8d add history to chat apis 2023-08-08 23:54:51 +08:00
imClumsyPanda c8b6d53ede add llmchain_with_history.py as example 2023-08-08 22:15:16 +08:00
liunux4odoo 135af5f3ff update knowledge base db orm:
1. set default values for file_count, file_version, create_time.
2. fix bug: add_doc_to_db
3. make add_kb_to_db more flexiable with existing kb
2023-08-08 21:47:20 +08:00
liunux4odoo 2b0f8caa62 improve recreate_vector_store:
1. allow empty knowledge base
2. skip unspported files instead of exception
2023-08-08 17:59:41 +08:00
liunux4odoo e918244159 move KBServiceFactory to server.knowledge_base.kb_service.base 2023-08-08 17:41:58 +08:00
liunux4odoo 444e1afad5 remove server/knowledge_base/knowledge_file.py 2023-08-08 16:51:37 +08:00
liunux4odoo c4a3995310 move commonto tools from kbservice.base to server.knowledge_base.utils 2023-08-08 16:40:18 +08:00
liunux4odoo 584e3a9234 remove server/knowledge_base/knowledge_base_factory.py 2023-08-08 16:21:00 +08:00
liunux4odoo 7e07f0bbf4 move configs to configs.model_config 2023-08-08 15:56:32 +08:00
zqt b61e0772c9 使用orm操作数据库 2023-08-08 14:25:55 +08:00
zqt 41fd1acc9c Merge remote-tracking branch 'origin/dev_fastchat' into dev_fastchat
# Conflicts:
#	server/knowledge_base/kb_service/default_kb_service.py
#	server/knowledge_base/kb_service/milvus_kb_service.py
#	server/knowledge_base/knowledge_base_factory.py
2023-08-08 14:06:13 +08:00
hzg0601 82494aec00 Merge branch 'dev_fastchat' of github.com:chatchat-space/langchain-ChatGLM into dev_fastchat 2023-08-08 13:39:31 +08:00
hzg0601 360bd0a559 update llm_api_sh.py 2023-08-08 13:39:19 +08:00
liunux4odoo 0746272525 remove server/knowledge_base/knowledge_base.py 2023-08-08 13:36:20 +08:00
glide-the de8db40f4b BaseChatOpenAIChain,支持基础的ChatOpenAI对话的Chain接入 2023-08-07 23:05:54 +08:00
glide-the 823eb06c5d BaseChatOpenAIChain,支持基础的ChatOpenAI对话的Chain接入 2023-08-07 22:57:13 +08:00
liunux4odoo 08493bffbb add a basic knowledge base management ui. 2023-08-07 21:00:55 +08:00
imClumsyPanda 035a199c32 update kb_server.base 2023-08-07 20:48:06 +08:00
liunux4odoo 44c713ef98 use KBServiceFactory to replace all the KnowledgeBase.
make KBServiceFactory support embed_model parameter.
rewrite api: recreate_vector_store.
fix some bugs.
2023-08-07 20:37:16 +08:00
zqt996 0f46185cfb
添加Milvus库 (#1011) 2023-08-07 16:56:57 +08:00
zqt 72951d95fb 添加milvus库支持 2023-08-07 16:32:34 +08:00
imClumsyPanda 18d31f5116 add KBService and KBServiceFactory class 2023-08-06 23:44:02 +08:00
glide-the 06af3f4c5e BaseChatOpenAIChain,支持基础的ChatOpenAI对话的Chain接入 2023-08-06 22:57:57 +08:00
imClumsyPanda b91d96ab0c update kb_doc_api.py 2023-08-06 18:32:10 +08:00
imClumsyPanda a447529c2e update kb_doc_api.py 2023-08-05 23:35:20 +08:00
imClumsyPanda 8773149a3e update api.py 2023-08-05 23:12:17 +08:00
imClumsyPanda 7f89efee4b fix kb_doc_api.py 2023-08-05 23:01:56 +08:00
imClumsyPanda 3f045cedb9 1. add add_doc and list_docs to KnowledgeBase class
2. add DB_ROOT_PATH to model_config.py.example
2023-08-05 22:57:19 +08:00
imClumsyPanda 313e590961 update DocumentLoader in knowledge_file.py 2023-08-05 21:51:07 +08:00
imClumsyPanda f68e432570 update table_name and column_name in SQL 2023-08-05 21:02:14 +08:00
imClumsyPanda cd0f2a2c41 update class method of KnowledgeBase and KnowledgeFile 2023-08-05 20:52:14 +08:00
imClumsyPanda 14a5de6a29 update class method of KnowledgeBase and KnowledgeFile 2023-08-05 13:51:05 +08:00
imClumsyPanda 7beeaacea6 update class method of KnowledgeBase and KnowledgeFile 2023-08-05 13:48:55 +08:00
imClumsyPanda e8a88f174d update class method of KnowledgeBase and KnowledgeFile 2023-08-05 13:48:30 +08:00
imClumsyPanda 206261cd0c update class method of KnowledgeBase and KnowledgeFile 2023-08-05 13:46:00 +08:00
imClumsyPanda 6c7adfbaeb change kb_api functions with KnowledgeBase class method 2023-08-05 03:15:41 +08:00
imClumsyPanda 7e1472a95b add KnowledgeBase class 2023-08-05 00:10:10 +08:00
imClumsyPanda 590367a5b5 add KnowledgeFile class 2023-08-04 23:54:26 +08:00
imClumsyPanda 775d46fecf format update in knowledge_base/utils.py 2023-08-04 23:14:43 +08:00
imClumsyPanda bc3ee83910 update kb_doc_api.py 2023-08-04 22:22:48 +08:00
liunux4odoo 5d1a0ec15d add recreate_vector_store to kb_doc_api, and the router in api.py. 2023-08-04 20:26:14 +08:00
liunux4odoo 46c7d8d169 allow kb_doc_api.upload_doc to override existed file by parameter.
update_doc is not needed.
2023-08-04 15:53:44 +08:00
imClumsyPanda b4f80ca370 update server.knowledge_base.utils 2023-08-04 15:32:42 +08:00
imClumsyPanda 7bfbe18011 update requirements.txt and kb_doc_api.py 2023-08-04 15:12:14 +08:00
liunux4odoo c4994e85df fix: knowledge_base_chat and search_engine_chat should stream json text
instead of dict. client should use json.loads.
2023-08-04 12:12:13 +08:00
liunux4odoo 88682c87ff 优化server下知识库相关模块的结构:将知识库相关操作从knowledge_base_chat移动到knowledge_base.utils;优化kb_doc_api中embeddings加载。 2023-08-04 10:16:30 +08:00
imClumsyPanda 329c24ee73 1. change bing_search_chat and duckduckgo_search_chat into search_engine_chat
2. add knowledge_base not found to knowledge_base_chat and add search_engine not found to search_engine_chat
2023-08-03 18:22:36 +08:00
imClumsyPanda b62ea6bd2a add top-k to search_chat apis and add top-k params in model_config 2023-08-03 17:06:43 +08:00
liunux4odoo 5c804aac75 make api and webui support top_k paramter 2023-08-03 15:47:53 +08:00
liunux4odoo df61f31c8e 修改knowledge_base_chat实现:利用缓存避免每次请求重新加载向量库;增加top_k参数。 2023-08-03 15:22:46 +08:00