Amazon EMR Serverless Now Handles Terabyte-Scale Shuffles
Amazon EMR Serverless just bumped its shuffle capacity from 200 GB to 1 TB per job, letting you run production-grade Apache Spark workloads without sweating storage limits. This means complex operations like massive table joins and high-cardinality aggregations are now totally doable across multi-terabyte datasets, with automatic disk spillover keeping your jobs stable when memory gets tight.
source: [aws/whats-new]