bartek@aws: ~/news
$ whoami
$ AWS Architect · DevOps · Cloud
Wednesday, November 18, 2026

Apache Spark Optimization Agent for EMR Serverless and Glue ETL Goes Live

AWS just dropped a game-changer for data engineers: an Apache Spark optimization agent that automatically analyzes your completed jobs and spits out cost or performance recommendations in minutes. No need to be a Spark wizard anymore—the agent grounds its suggestions in your actual job telemetry, so anyone can tune their pipelines like a pro.

source: [aws/big-data-blog]