Skip to content

Commit 07588b0

Browse files
ywang96shreyankg
authored andcommitted
[Misc][Doc] Minor benchmark README update (vllm-project#14874)
Signed-off-by: Roger Wang <[email protected]>
1 parent a5709c7 commit 07588b0

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

benchmarks/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -82,10 +82,10 @@ Then run the benchmarking script
8282
# wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json
8383
MODEL_NAME="NousResearch/Hermes-3-Llama-3.1-8B"
8484
NUM_PROMPTS=10
85-
BACKEND="openai-chat"
85+
BACKEND="vllm"
8686
DATASET_NAME="sharegpt"
8787
DATASET_PATH="<your data path>/ShareGPT_V3_unfiltered_cleaned_split.json"
88-
python3 vllm/benchmarks/benchmark_serving.py --backend ${BACKEND} --model ${MODEL_NAME} --endpoint /v1/chat/completions --dataset-name ${DATASET_NAME} --dataset-path ${DATASET_PATH} --num-prompts ${NUM_PROMPTS}
88+
python3 vllm/benchmarks/benchmark_serving.py --backend ${BACKEND} --model ${MODEL_NAME} --endpoint /v1/completions --dataset-name ${DATASET_NAME} --dataset-path ${DATASET_PATH} --num-prompts ${NUM_PROMPTS}
8989
```
9090

9191
If successful, you will see the following output

0 commit comments

Comments
 (0)