f95d41ef47
[BUG] 修复csv文件读取后，单行数据被分成多段。
2023-08-26 11:45:01 +08:00
7291e77978
support for bge-large-zh-noinstruct and openai text-embedding-ada-002 ( #1119 )
...
* support for bge-large-zh-noinstruct and openai text-embedding-ada-002
* 完善了readme,修改了BGE模型的载入方式
* 补充了readme中bge-large-zh-noinstruct的信息
* Update faiss_kb_service.py
* Update utils.py
---------
Co-authored-by: zR <zRzRzRzRzRzRzR>
Co-authored-by: imClumsyPanda <littlepanda0716@gmail.com>
2023-08-23 22:55:53 +08:00
6d1ea9bc99
Update utils.py ( #1128 )
...
不区分文件扩展名的大小写。
2023-08-17 21:09:05 +08:00
a47240e871
fix KnowledgeFile: set text_splitter_name in database to SpacyTextSplitter if it is not set
2023-08-16 10:14:47 +08:00
a08fe994c2
更新API与ApiReuest：
...
1. 重新整理webui_pages/utils与server/knowledge_base间的工具依赖
2.
将delete_knowledge_base与delete_doc接口从delete改为post.delete不支持body参数
3. 修复update_doc
4. 修复部分bug
2023-08-11 08:45:26 +08:00
ef098111dc
update webui and utils
2023-08-10 23:04:05 +08:00
8a4d9168fa
update import pkgs and format
2023-08-10 21:26:05 +08:00
8df00d0b04
add SCORE_THRESHOLD to faiss and milvus kb service
2023-08-10 00:36:59 +08:00
02b9d57072
update textsplitter and pdfloader
2023-08-09 23:36:43 +08:00
24a280ce8c
re-add zh_title_enhance.py
2023-08-09 23:09:24 +08:00
1b70fb5f9b
update faiss_kb_service.py
2023-08-09 22:57:36 +08:00
c7b91bfaf1
update api/kb_doc_api and knowledge base management ui:
...
1. add update_doc to api which can udpate vector store from existed
content file
2. add parameter `delete_content` to delete_doc api. user can decide
whether delete local content file when delete doc.
3. fix bug in ApiReqeust.upload_doc
4. support listing docs existed in local folder bu not in db
2023-08-09 16:52:04 +08:00
2b0f8caa62
improve recreate_vector_store:
...
1. allow empty knowledge base
2. skip unspported files instead of exception
2023-08-08 17:59:41 +08:00
e918244159
move KBServiceFactory to server.knowledge_base.kb_service.base
2023-08-08 17:41:58 +08:00
c4a3995310
move commonto tools from kbservice.base to server.knowledge_base.utils
2023-08-08 16:40:18 +08:00
584e3a9234
remove server/knowledge_base/knowledge_base_factory.py
2023-08-08 16:21:00 +08:00
0746272525
remove server/knowledge_base/knowledge_base.py
2023-08-08 13:36:20 +08:00
18d31f5116
add KBService and KBServiceFactory class
2023-08-06 23:44:02 +08:00
b91d96ab0c
update kb_doc_api.py
2023-08-06 18:32:10 +08:00
7e1472a95b
add KnowledgeBase class
2023-08-05 00:10:10 +08:00
590367a5b5
add KnowledgeFile class
2023-08-04 23:54:26 +08:00
775d46fecf
format update in knowledge_base/utils.py
2023-08-04 23:14:43 +08:00
b4f80ca370
update server.knowledge_base.utils
2023-08-04 15:32:42 +08:00
7bfbe18011
update requirements.txt and kb_doc_api.py
2023-08-04 15:12:14 +08:00
c4994e85df
fix: knowledge_base_chat and search_engine_chat should stream json text
...
instead of dict. client should use json.loads.
2023-08-04 12:12:13 +08:00
88682c87ff
优化server下知识库相关模块的结构：将知识库相关操作从knowledge_base_chat移动到knowledge_base.utils；优化kb_doc_api中embeddings加载。
2023-08-04 10:16:30 +08:00
dcf49a59ef
v0.2.0 first commit
2023-07-27 23:22:07 +08:00
imClumsyPanda
zR
xain
liunux4odoo
liunux4odoo