Skip to content

Commit d79d9f0

Browse files
authored
[Bug] Fix cpu disable shared_experts VLLM_DISABLE_SHARED_EXPERTS_STREAM (#28157)
Signed-off-by: yewentao256 <[email protected]>
1 parent b6a248b commit d79d9f0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/platforms/cpu.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -299,7 +299,7 @@ def check_and_update_config(cls, vllm_config: VllmConfig) -> None:
299299
os.environ["TORCHINDUCTOR_COMPILE_THREADS"] = "1"
300300

301301
# Disable multi-stream for shared experts as no Stream on CPU
302-
os.environ["VLLM_DISABLE_SHARED_EXPERTS_STREAM"] = "0"
302+
os.environ["VLLM_DISABLE_SHARED_EXPERTS_STREAM"] = "1"
303303

304304
# Intel OpenMP setting
305305
ld_preload_str = os.getenv("LD_PRELOAD", "")

0 commit comments

Comments
 (0)