Posts

All the articles I've posted.

• 24 MIN READ•May 22, 2026

  Maintaining Apache Iceberg Tables: Compaction, Snapshot Expiration, and Orphan File Cleanup

  An in-depth guide to orchestrating maintenance operations on Apache Iceberg tables, covering bin-packing, sort-based, Z-Order compaction, snapshot expiration, and orphan file removal, with query acceleration details for the Dremio engine.

  Apache IcebergCompactionData Engineering
• 24 MIN READ•May 22, 2026

  Apache Iceberg with Spark: Create, MERGE, Upsert, and Evolve Tables End to End

  A comprehensive developer guide to configuring Apache Spark with Apache Iceberg, executing transactional writes, and managing schema evolution.

  apache sparkapache icebergdata engineering
• 21 MIN READ•May 22, 2026

  Building a Multicloud Agentic Lakehouse Reference Architecture

  A reference architecture for building an open, multicloud Data Lakehouse optimized for AI Agents using Apache Polaris, Apache Iceberg, and Dremio.

  data lakehouseagentic lakehouseapache polaris