bartek@aws: ~/news
$ whoami
$ AWS Architect · DevOps · Cloud

tag: Spark Connect

show all
Tuesday, August 4, 2026

Interactive Spark Development Just Got Easier on Amazon EMR

Amazon EMR on EC2 now lets you run interactive Apache Spark sessions with Spark Connect—perfect for data engineers and scientists who love iterating in real-time. Code directly in SageMaker Unified Studio, Jupyter, or VS Code while your Spark cluster handles the heavy lifting behind the scenes. The client-server architecture keeps your dev environment cozy while infrastructure stays on the cluster, making ad hoc exploration and debugging a breeze. Monitor everything through the Spark UI and EMR console. Available now on emr-spark-8.0 and later across all AWS regions (except GovCloud and China).