-
Notifications
You must be signed in to change notification settings - Fork 607
Closed
Labels
TaskAPISomething related to the TaskAPI kindSomething related to the TaskAPI kindenhancementNew feature or requestNew feature or request
Milestone
Description
Description
Allow setting shared memory for TaskAPI similar to other inference APIs.
Motivation
Currently it is not possible to use more than one PyTorch dataloader to train a model because of the shared memory limits, they fail with the error:
ERROR: Unexpected bus error encountered in worker. This might be caused by insufficient shared memory (shm).
Additional context
This was previously discussed in "Allow setting the shared memory (shm) size for the API container" #1638.
Metadata
Metadata
Assignees
Labels
TaskAPISomething related to the TaskAPI kindSomething related to the TaskAPI kindenhancementNew feature or requestNew feature or request