update readme

This commit is contained in:
hzg0601 2023-08-10 14:49:50 +08:00
parent 9525915a85
commit a59ab911a7
1 changed files with 1 additions and 7 deletions

View File

@ -204,13 +204,7 @@ embedding_model_dict = {
$ python server/llm_api.py $ python server/llm_api.py
``` ```
如果想启动多个**LLM模型**服务: 以如上方式启动LLM服务会以nohup命令在后台运行fastchat服务如需停止服务可以运行如下命令
```shell
$python server/llm_api_luanch.py --model-path-address `model-path1@host1@port1` `model-path2@host2@port2`
```
以如上方式启动LLM服务会以nohup命令在后台运行fastchat服务如需停止服务可以运行如下命令
```shell ```shell
$python server/llm_api_shutdown.py --serve all $python server/llm_api_shutdown.py --serve all