Pinterest Uses Event Time Watermarks to Finalize Petabyte Scale Data Partitions
📝
内容提要
Pinterest has introduced event time-based partition finalization for its database ingestion framework. The mechanism uses Apache Flink to track event time and Apache Iceberg metadata to publish a...