Tag:metadata
Articles tagged "metadata".
- 31 MIN READ•Sep 10, 2026
Context Engineering for Data Agents
Why text-to-SQL accuracy collapses on enterprise schemas, the five kinds of context an agent needs, where each one hides, and how to make the semantics legible.
context engineeringsemantic layertext-to-SQL - 31 MIN READ•Sep 10, 2026
Migrating Into Iceberg Without Moving Data
add_files, snapshot, and migrate compared: the three in-place paths into Iceberg, the reconciliation each requires, the layout traps, and the rollback story.
Apache Icebergmigrationmetadata - 31 MIN READ•Sep 10, 2026
Partition Statistics Files in Apache Iceberg
The underused Iceberg metadata for planning: what the partition statistics file holds, what the spec guarantees, how to write one, and when it earns its slot.
Apache Icebergquery planningmetadata - 29 MIN READ•Sep 2, 2026
Metadata Platforms in 2026: DataHub, OpenMetadata, Atlan, and Catalog Convergence
How the technical catalog and the metadata platform are converging in 2026, and how to arrange the two layers for a lakehouse.
DataHubOpenMetadataAtlan - 32 MIN READ•Aug 25, 2026
Parquet-Only Manifests in Iceberg v4: Why the Metadata Layer Is Going Columnar
Iceberg v4 is moving manifests from Avro to Parquet so planners can read only the stats they need. Why the metadata layer is going columnar.
Apache IcebergIceberg v4Parquet - 31 MIN READ•Aug 24, 2026
The Hidden Cost of Tiny Iceberg Commits
Trace what one tiny Iceberg commit writes, then model hourly, per-minute, and per-second cadences so streaming costs become arithmetic, not adjectives.
Apache Icebergstreamingmetadata - 31 MIN READ•Aug 24, 2026
Iceberg v4's Adaptive Metadata Tree, Explained From First Principles
Iceberg v4's adaptive metadata tree, explained from first principles: why commits rewrite too much today and how the tree makes change cheaper.
Apache IcebergIceberg v4metadata - 30 MIN READ•Aug 24, 2026
Why Iceberg v4 Is Really About Making the Cost of Change Proportional to the Change
Iceberg v4 is really about making the cost of a change proportional to the change. The principle, the current tax, and what the redesign pays down.
Apache IcebergIceberg v4metadata - 21 MIN READ•Aug 4, 2026
Reading the Apache Iceberg V4 Proposals Before They Land
A field guide to the Apache Iceberg V4 proposals: adaptive metadata trees, single-file commits, typed statistics, column families, and what is safe.
Apache IcebergIceberg V4Metadata - 5 MIN READ•Feb 18, 2026
How a Self-Documenting Semantic Layer Reduces Data Team Toil
Every data team knows documentation is important. And almost every data team has a backlog of undocumented tables, unlabeled columns, and outdated descriptio...
semantic layerdata engineeringdocumentation - 3 MIN READ•Sep 16, 2025
The Endgame – Building an Autonomous Optimization Pipeline for Apache Iceberg
Learn how to automate compaction, snapshot expiration, and layout optimization in Apache Iceberg using metadata-driven triggers and orchestration tools.
Apache IcebergAutomationCompaction