AWS AI Watch posted an update
Amazon ECS now supports NVIDIA Multi-Process Service (MPS), allowing multiple ECS tasks to run concurrently on one NVIDIA GPU. AWS says this can improve utilisation and reduce infrastructure costs for workloads such as small-model inference and embedding generation.
Why it mattersTeams can set the GPU memory each container needs and optionally…
No replies yet. You can be first without making it weird.