Commit Graph

58 Commits

Author SHA1 Message Date
liunux4odoo 96f69edf7b
修复重建知识库界面无反应的问题,添加一些log信息 (#1258)
* close #1172: 给webui_page/utils添加一些log信息,方便定位错误

* 修复:重建知识库时页面未实时显示进度

---------

Co-authored-by: liunux4odoo <liunu@qq.com>
2023-08-26 18:26:38 +08:00
liunux4odoo 9ca53fa3ad
fix #1224: failed to load json and pdf files (#1252)
Co-authored-by: liunux4odoo <liunu@qq.com>
2023-08-26 14:21:59 +08:00
imClumsyPanda 33ce276e3e change default search_engine option to 'duckduckgo' 2023-08-25 15:18:43 +08:00
liunux4odoo f40bb69224 优化FAISS向量库多文件操作;修复recreate_vector_store,大量文件时不再超时。 2023-08-20 19:10:29 +08:00
liunux4odoo 69627a2fa3 update chat and knowledge base api: unify exception processing and return types 2023-08-19 15:14:45 +08:00
liunux4odoo d4cf77170a fix webui: correct error messages 2023-08-18 11:47:49 +08:00
liunux4odoo 67b8ebef52 update api and webui:
1. 增加search_docs接口,返回原始知识库检索文档,close #1103
2. 为FAISS检索增加score_threshold参数。milvus和PG暂不支持
2023-08-16 13:18:58 +08:00
liunux4odoo 1551adb867 fix webui: use kb_names as selected_kb's options to avoid index error after delete_doc 2023-08-16 10:04:17 +08:00
liunux4odoo f9d5038e59 fix webui utils: remove unneeded error check 2023-08-16 09:33:55 +08:00
liunux4odoo 7c0e9c46db fix api & webui: 1.add logs, 2. check json response, 3. set timeout=False in recreate_vector_stoore 2023-08-15 14:24:54 +08:00
liunux4odoo ec984205ae fix knowledge base management:
1. docs in database were note deleted when clear vector store
2. diable buttons when local doc file not exist.
2023-08-14 19:09:02 +08:00
liunux4odoo cc08e2cb96 update api and webui:
1. add download_doc to api
2. return local path or http url in kowledge_base_chat depends on
   no_remote_api
3. change assistant avater in webui
2023-08-14 11:46:36 +08:00
imClumsyPanda b543f49278 update webui design 2023-08-13 22:25:01 +08:00
imClumsyPanda 77364c046e withdraw conversation management func 2023-08-13 17:53:59 +08:00
imClumsyPanda 1b07648238 fix bug in webui search_engine_chat 2023-08-13 16:20:53 +08:00
liunux4odoo 5df3de8dd0 fix webui: keep chat session sequence when delete session, again 2023-08-13 14:58:14 +08:00
liunux4odoo 9974bf33a0 fix webui: switch to created chat session automatically 2023-08-13 12:59:06 +08:00
imClumsyPanda 353d9fc72b update init_database.py 2023-08-13 10:25:02 +08:00
liunux4odoo b59b34eaf7 fix webui: switch to created chat session automatically 2023-08-12 22:58:13 +08:00
liunux4odoo 1535059d2c fix webui: create and rename chat session 2023-08-12 22:30:21 +08:00
imClumsyPanda 2ad33e010d update webui.py and README.md 2023-08-12 14:08:21 +08:00
imClumsyPanda e65458a506 update requirements.txt 2023-08-12 10:44:04 +08:00
imClumsyPanda 90d385cb92 update webui.dialogue layout 2023-08-12 02:30:50 +08:00
imClumsyPanda 844b15a6f7 update webui.knowledge_base layout 2023-08-12 01:26:17 +08:00
imClumsyPanda afc6aa968d update webui layout 2023-08-11 23:40:41 +08:00
liunux4odoo 2bb9a7949f fix: delete knowledge base error 2023-08-11 23:35:27 +08:00
liunux4odoo 9add46ebbd add recreate vector store to knowledge base mamagement ui 2023-08-11 14:11:34 +08:00
liunux4odoo 2a57f49d80 update knowledge base management ui.
remove numpy/pandas from requirements, move them to webui requirements
2023-08-11 13:53:20 +08:00
liunux4odoo a08fe994c2 更新API与ApiReuest:
1. 重新整理webui_pages/utils与server/knowledge_base间的工具依赖
2.
将delete_knowledge_base与delete_doc接口从delete改为post.delete不支持body参数
3. 修复update_doc
4. 修复部分bug
2023-08-11 08:45:26 +08:00
imClumsyPanda 3c44cf65cd update webui layout 2023-08-10 23:51:10 +08:00
liunux4odoo b733a47902 split requirements to 2 parts: basic with api; webui 2023-08-10 15:51:22 +08:00
liunux4odoo 9ed91f0e8a automatically init vector store info to database when run api.py & webui.py 2023-08-10 14:12:02 +08:00
liunux4odoo 7a57f67587 fix: bug when delete chat session 2023-08-10 13:06:30 +08:00
liunux4odoo d89fcb3b2e update knowledge base management page:
1. move get_kb_details & get_doc_details to utils.py
2. adjust aggrid columns width.
2023-08-10 11:37:14 +08:00
liunux4odoo 222689ed5b update kb and search chat: disable streaming in swagger besides streaming in ApiRequest 2023-08-09 23:35:36 +08:00
liunux4odoo 450b23c4f2 update knowledge base management api and ui 2023-08-09 22:00:33 +08:00
liunux4odoo c7b91bfaf1 update api/kb_doc_api and knowledge base management ui:
1. add update_doc to api which can udpate vector store from existed
   content file
2. add parameter `delete_content` to delete_doc api. user can decide
   whether delete local content file when delete doc.
3. fix bug in ApiReqeust.upload_doc
4. support listing docs existed in local folder bu not in db
2023-08-09 16:52:04 +08:00
liunux4odoo 25280e0cea update webui: use history_len as pairs of conversation 2023-08-09 14:11:10 +08:00
liunux4odoo 4da7c04859 fix: parse history parameter to correct type 2023-08-09 12:09:45 +08:00
liunux4odoo 973d3097e7 fix webui_pages/utils.py: support history parameter for chat_chat 2023-08-09 11:00:22 +08:00
liunux4odoo b98f5fd0b9 update knowledge base kbservice and api:
1. make huggingfaceembeddings hashable
2. unify embeddings' loading method for all kbservie
3. make ApiRequest skip empty content when streaming json to avoid dict
   KeyError
2023-08-09 10:46:01 +08:00
liunux4odoo ec76adc81d update knowledge base management ui 2023-08-08 23:58:44 +08:00
liunux4odoo 2b0f8caa62 improve recreate_vector_store:
1. allow empty knowledge base
2. skip unspported files instead of exception
2023-08-08 17:59:41 +08:00
liunux4odoo 08493bffbb add a basic knowledge base management ui. 2023-08-07 21:00:55 +08:00
liunux4odoo 5d1a0ec15d add recreate_vector_store to kb_doc_api, and the router in api.py. 2023-08-04 20:26:14 +08:00
liunux4odoo 46c7d8d169 allow kb_doc_api.upload_doc to override existed file by parameter.
update_doc is not needed.
2023-08-04 15:53:44 +08:00
liunux4odoo 3318cef751 update streamlit ui: support latest knowledge base and search engine
chat api; export messages to markdown.
2023-08-04 12:52:58 +08:00
liunux4odoo 27d49be706 make apirequest support streaming dict 2023-08-04 12:49:39 +08:00
imClumsyPanda 329c24ee73 1. change bing_search_chat and duckduckgo_search_chat into search_engine_chat
2. add knowledge_base not found to knowledge_base_chat and add search_engine not found to search_engine_chat
2023-08-03 18:22:36 +08:00
liunux4odoo 5c804aac75 make api and webui support top_k paramter 2023-08-03 15:47:53 +08:00