Amazon EMR Gets Native Data Quality Checks for Spark Jobs
Amazon EMR now validates data quality directly within Apache Spark jobs using AWS Glue's Data Quality Definition Language, catching bad data before it reaches downstream systems. The feature supports 30+ rule types including ML-based anomaly detection, works across EC2, EKS, and Serverless modes with Apache Iceberg, Hudi, and Delta Lake, and is available at no extra cost in all AWS regions.
source: [aws/whats-new]