Amazon ECS Now Lets You Slice GPUs Into Smaller Pieces
Amazon ECS now supports fractional GPU scheduling on EC2 G6f instances, letting you run AI inference and graphics workloads on GPU partitions as small as one-eighth of an NVIDIA L4 GPU (3 GB memory) by setting GPU=0.125, 0.25, or 0.5 in your task definition. This capability is live across all AWS Regions where G6f instances are available, helping you cut infrastructure costs by right-sizing containers instead of provisioning full GPUs.
source: [aws/whats-new]