update readme
This commit is contained in:
parent
9525915a85
commit
a59ab911a7
|
|
@ -204,13 +204,7 @@ embedding_model_dict = {
|
||||||
$ python server/llm_api.py
|
$ python server/llm_api.py
|
||||||
```
|
```
|
||||||
|
|
||||||
如果想启动多个**LLM模型**服务:
|
以如上方式启动LLM服务会以nohup命令在后台运行fastchat服务,如需停止服务,可以运行如下命令:
|
||||||
|
|
||||||
```shell
|
|
||||||
$python server/llm_api_luanch.py --model-path-address `model-path1@host1@port1` `model-path2@host2@port2`
|
|
||||||
```
|
|
||||||
|
|
||||||
注:以如上方式启动LLM服务会以nohup命令在后台运行fastchat服务,如需停止服务,可以运行如下命令:
|
|
||||||
|
|
||||||
```shell
|
```shell
|
||||||
$python server/llm_api_shutdown.py --serve all
|
$python server/llm_api_shutdown.py --serve all
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue