Posts - Page 3
All the articles I've posted, page 3.
- 32 MIN READ•Sep 2, 2026
Geospatial Data in Apache Iceberg: Geometry, Geography, and GeoParquet
How Iceberg v3 geometry and geography types, bounding boxes, and native Parquet types give spatial data first-class standing.
Apache IcebergGeospatialGeoParquet - 31 MIN READ•Sep 2, 2026
Default Column Values and Field IDs: How Iceberg Schema Evolution Works at the Spec Level
How field IDs and initial and write defaults let Iceberg change schemas on large tables without rewriting data, at the spec level.
Apache IcebergSchema EvolutionField IDs - 30 MIN READ•Sep 2, 2026
The Iceberg Table Properties That Actually Matter
The Iceberg table properties that decide file count, pruning, write amplification, retention, and metadata growth, by workload.
Apache IcebergTable PropertiesTuning - 33 MIN READ•Sep 2, 2026
Inside the Puffin File Format
The Puffin file format inside out, byte by byte, covering Theta sketches for distinct values and deletion vectors.
Apache IcebergPuffinFile Format - 30 MIN READ•Sep 2, 2026
The Lakehouse Ingestion Tool Landscape: Fivetran, Airbyte, dlt, and CDC vs Batch
How Fivetran, Airbyte, dlt, and CDC and streaming tools land well-behaved Apache Iceberg tables, and how to choose and maintain them.
IngestionCDCFivetran - 30 MIN READ•Sep 2, 2026
Local Iceberg Development Environments: Docker, MinIO, and In-Memory Catalogs for CI
Local Iceberg development environments: in-process catalogs, a Docker Compose stack with MinIO, and CI configurations that run either.
Apache IcebergLocal DevelopmentMinIO - 29 MIN READ•Sep 2, 2026
Metadata Platforms in 2026: DataHub, OpenMetadata, Atlan, and Catalog Convergence
How the technical catalog and the metadata platform are converging in 2026, and how to arrange the two layers for a lakehouse.
DataHubOpenMetadataAtlan - 31 MIN READ•Sep 2, 2026
Moving Iceberg Tables Between Catalogs Without Rewriting Data
Why moving Iceberg tables between catalogs is a pointer copy, and the protocol that makes a cutover safe for one table or thousands.
Apache IcebergCatalogsMigration - 30 MIN READ•Sep 2, 2026
Logs, Traces, and Metrics as Tables: Building an OpenTelemetry Data Lake on Iceberg
Building an OpenTelemetry data lake on Iceberg: schemas for spans, logs, and metrics, ingestion, query patterns, and retention.
OpenTelemetryApache IcebergLogs - 31 MIN READ•Sep 2, 2026
Orchestration in 2026: Airflow 3 vs Dagster vs Prefect vs Event-Driven
Where Airflow 3, Dagster, Prefect, and event-driven triggering stand for lakehouse pipelines in 2026, after the Prefect acquisition of Dagster.
AirflowDagsterPrefect - 29 MIN READ•Sep 2, 2026
Postgres Meets the Lakehouse: pg_lake, pg_duckdb, and When Postgres Is Enough
What pg_lake, pg_duckdb, and pg_mooncake do at the Iceberg level, and honest thresholds for when Postgres is enough.
Postgrespg_lakepg_duckdb - 30 MIN READ•Sep 2, 2026
Schema Registries and Event Schemas: Avro, Protobuf, and JSON Schema on the Way Into the Lakehouse
How Avro, Protobuf, and JSON Schema evolve through a registry, and how that maps to the schema evolution rules of Iceberg.
Schema RegistryAvroProtobuf