In this episode, Lisa and Scott explore recent updates in ecosystem technologies including Apache Iceberg, Apache Flink, Polars, delta-rs, highlighting their frustrations in agent workflows and a potential oversight on the importance of XML.
- Iceberg 1.12: REST catalogs, C++ support, equality deletes, and interoperability
- Polaris catalog governance, lineage, pagination, and deletion policies
- Flink updates, including State Fun deprecation and native XML functions
- Polars 2.0, streaming execution, lazy frames, and memory efficiency
- Delta Rust releases, partition handling, correctness fixes, and migration
- Parquet performance, FastLanes benchmarks, and Arrow’s Intel macOS support
- AI agent orchestration with Omnigent, Kubernetes sandboxes, Spark pipelines, and thrash detection
