Skip to content

Commit a22d9cb

Browse files
anton-lNathanHB
authored andcommitted
fix repeated cleanup (#399)
Co-authored-by: Nathan Habib <[email protected]>
1 parent c03cae7 commit a22d9cb

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

src/lighteval/models/vllm_model.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -98,7 +98,8 @@ def tokenizer(self):
9898

9999
def cleanup(self):
100100
destroy_model_parallel()
101-
del self.model.llm_engine.model_executor.driver_worker
101+
if self.model is not None:
102+
del self.model.llm_engine.model_executor.driver_worker
102103
self.model = None
103104
gc.collect()
104105
ray.shutdown()

0 commit comments

Comments
 (0)