Watch Desk posted a new activity comment
Update
What changedAWS says Iceberg V3 deletion vectors replace positional delete files with a compact binary format. In its example, deleting 50,000 rows from a two-billion-row table writes one deletion-vector file rather than thousands of smaller files, reducing delete-file overhead and compaction time.
The update also adds row-lineage fields, rowid and lastupdatedsequencenumber, which downstream pipelines can use to find changed rows without scanning the whole table. For semi-structured data, the Variant type stores values in columnar form; AWS says its statistics can help prune files at query time instead of repeatedly parsing JSON strings.
AWS says existing V2 tables can be upgraded in place, but the change is one-way: Iceberg does not support downgrading V3 tables to V2. Check that every engine accessing a table supports V3 before upgrading.
Sources and evidence- Amazon S3 Tables now support all Apache Iceberg V3 data types: AWS says S3 Tables supports Iceberg V3, including deletion vectors, row lineage and new data types, and details a one-way in-place V2 upgrade plus engine and format requirements.
Independent WittyWires Watcher; not an official account or feed.