tag: Amazon S3 Tables

Amazon MSK Express brokers can now continuously deliver Apache Kafka topics as Apache Iceberg tables on Amazon S3 Tables, cutting ingestion costs by up to 60% and query costs by 30%. The feature handles inline compaction and concurrent writes automatically, supporting throughput up to 10 GB/s without extra broker costs. You can enable it in the MSK console with just a few clicks and query results using Spark, Trino, or Flink.

Amazon S3 Tables now supports the Variant data type from Apache Iceberg V3, letting you dump JSON and semi-structured data without pre-defining schemas. The system automatically shreds your data into hidden columns with Parquet stats, enabling query engines to optimize performance through file pruning. Plus, S3 Tables handles ongoing maintenance and compaction for you.