Tag:PyIceberg

Articles tagged "PyIceberg".

• 30 MIN READ•Sep 10, 2026

  What to Assert When You Test an Iceberg Pipeline

  Fixtures, in-memory catalogs, and golden metadata: the assertions that catch wrong rows, unsafe reruns, schema drift, and concurrent-write corruption in CI.

  Apache IcebergtestingCI
• 30 MIN READ•Sep 2, 2026

  Local Iceberg Development Environments: Docker, MinIO, and In-Memory Catalogs for CI

  Local Iceberg development environments: in-process catalogs, a Docker Compose stack with MinIO, and CI configurations that run either.

  Apache IcebergLocal DevelopmentMinIO
• 31 MIN READ•Sep 2, 2026

  Moving Iceberg Tables Between Catalogs Without Rewriting Data

  Why moving Iceberg tables between catalogs is a pointer copy, and the protocol that makes a cutover safe for one table or thousands.

  Apache IcebergCatalogsMigration
• 31 MIN READ•Aug 25, 2026

  Serverless Iceberg Ingestion with PyIceberg and DuckDB: Micro-Batches Without a Spark Cluster

  Land small Iceberg micro-batches with PyIceberg and DuckDB in a serverless function. Commits, concurrency, and why Spark is the wrong default.

  Apache IcebergPyIcebergDuckDB
• 31 MIN READ•Aug 19, 2026

  Building Lightweight Serverless Ingestion to Apache Iceberg with PyIceberg and DuckDB

  Build lightweight serverless ingestion to Apache Iceberg with PyIceberg and DuckDB, running small feeds in functions that bill for seconds.

  PyIcebergDuckDBserverless
• 31 MIN READ•Jul 28, 2026

  Building Iceberg Pipelines in Python Without Standing Up Spark

  A large share of production transformations fit comfortably on one machine. PyIceberg, DuckDB, and branch isolation give you a production path that debugs.

  Apache IcebergPythonPyIceberg
• 7 MIN READ•Apr 29, 2026

  Using Apache Iceberg with Python and MPP Query Engines

  Access Iceberg tables from Python with PyIceberg, DuckDB, and Polars, or through MPP engines like Dremio, Spark, and Trino. Here is how each approach works.

  Python Apache IcebergPyIcebergDuckDB Iceberg