https://andrewmadson.com/blog.html Blog posts and newsletters by Andrew Madson from Fivetran, Dremio, Tobiko Data, Medium, Substack, and more. en-us Thu, 19 Mar 2026 00:00:00 GMT https://www.linkedin.com/pulse/architecture-agents-building-open-data-infrastructure-andrew-madson-9u2sc https://www.linkedin.com/pulse/architecture-agents-building-open-data-infrastructure-andrew-madson-9u2sc Thu, 19 Mar 2026 00:00:00 GMT LinkedIn AI Agents Open Data Data Infrastructure The Architecture of Agents: Building Open Data Infrastructure Today for the AI Factory of Tomorrow — published on LinkedIn. https://andrewmadson.substack.com/p/the-ai-survival-guide-why-open-data https://andrewmadson.substack.com/p/the-ai-survival-guide-why-open-data Wed, 18 Mar 2026 00:00:00 GMT Substack AI Open Data Data Infrastructure The AI Survival Guide - Why Open Data Infrastructure Is No Longer Optional — published on Substack. https://www.fivetran.com/blog/governing-your-lakehouse-with-fivetran-managed-data-lake-service https://www.fivetran.com/blog/governing-your-lakehouse-with-fivetran-managed-data-lake-service Mon, 16 Mar 2026 00:00:00 GMT Fivetran Data Lakehouse Data Governance Governing Your Lakehouse with Fivetran Managed Data Lake Service — published on Fivetran. https://www.linkedin.com/pulse/did-context-windows-just-kill-rag-andrew-madson-ggmyc https://www.linkedin.com/pulse/did-context-windows-just-kill-rag-andrew-madson-ggmyc Wed, 11 Mar 2026 00:00:00 GMT LinkedIn AI RAG Context Windows Did Context Windows Just Kill RAG? — published on LinkedIn. https://andrewmadson.substack.com/p/apache-iceberg-v4-what-it-means-for https://andrewmadson.substack.com/p/apache-iceberg-v4-what-it-means-for Tue, 10 Mar 2026 00:00:00 GMT Substack Apache Iceberg AI Data Stack Apache Iceberg v4 - What It Means for Your AI Data Stack — published on Substack. https://www.linkedin.com/pulse/storing-data-history-without-regretting-andrew-madson-abeif https://www.linkedin.com/pulse/storing-data-history-without-regretting-andrew-madson-abeif Mon, 09 Mar 2026 00:00:00 GMT LinkedIn Data History Data Engineering Storing Data History Without Regretting It — published on LinkedIn. https://andrewmadson.substack.com/p/open-data-infrastructure-to-infinity https://andrewmadson.substack.com/p/open-data-infrastructure-to-infinity Sat, 28 Feb 2026 00:00:00 GMT Substack Open Data Data Infrastructure Apache Iceberg Open Data Infrastructure - To Infinity and Beyond! — published on Substack. https://www.linkedin.com/pulse/when-data-your-advantage-vendors-hold-hostage-andrew-madson-pixoc https://www.linkedin.com/pulse/when-data-your-advantage-vendors-hold-hostage-andrew-madson-pixoc Thu, 26 Feb 2026 00:00:00 GMT LinkedIn Data Strategy Vendor Lock-In When Data Is Your Advantage, Vendors Hold It Hostage — published on LinkedIn. https://andrewmadson.substack.com/p/iceberg-file-format-api-release https://andrewmadson.substack.com/p/iceberg-file-format-api-release Tue, 24 Feb 2026 00:00:00 GMT Substack Apache Iceberg File Formats API Iceberg File Format API Release — published on Substack. https://andrewmadson.substack.com/p/apache-datafusion-a-data-engineers https://andrewmadson.substack.com/p/apache-datafusion-a-data-engineers Mon, 23 Feb 2026 00:00:00 GMT Substack Apache DataFusion Query Engine Data Engineering Apache DataFusion: A Data Engineer’s Guide to the Query Engine Reshaping How We Build Data Systems — published on Substack. https://www.fivetran.com/blog/the-impact-of-apache-polaris-graduating-to-top-level-apache-project https://www.fivetran.com/blog/the-impact-of-apache-polaris-graduating-to-top-level-apache-project Thu, 19 Feb 2026 00:00:00 GMT Fivetran Apache Polaris Open Source The Impact of Apache Polaris Graduating to Top-Level Apache Project — published on Fivetran. https://medium.com/@andymadson/odbc-and-jdbc-row-oriented-relics-and-the-rise-of-adbc-9d049c459902 https://medium.com/@andymadson/odbc-and-jdbc-row-oriented-relics-and-the-rise-of-adbc-9d049c459902 Tue, 17 Feb 2026 00:00:00 GMT Medium ODBC JDBC ADBC ODBC and JDBC: Row-Oriented Relics and the Rise of ADBC — published on Medium. https://www.linkedin.com/pulse/icymi-wtf-adbc-andrew-madson-hqjkc https://www.linkedin.com/pulse/icymi-wtf-adbc-andrew-madson-hqjkc Tue, 17 Feb 2026 00:00:00 GMT LinkedIn ADBC Data Connectivity ICYMI - WTF is ADBC? — published on LinkedIn. https://www.linkedin.com/pulse/principles-testing-quality-data-pipelines-andrew-madson-g7ykf https://www.linkedin.com/pulse/principles-testing-quality-data-pipelines-andrew-madson-g7ykf Sat, 14 Feb 2026 00:00:00 GMT LinkedIn Data Pipelines Testing Principles of Testing Quality in Data Pipelines — published on LinkedIn. https://medium.com/@andymadson/the-four-pillars-of-ai-systems-and-the-data-they-need-21ba99406874 https://medium.com/@andymadson/the-four-pillars-of-ai-systems-and-the-data-they-need-21ba99406874 Thu, 12 Feb 2026 00:00:00 GMT Medium AI Data Strategy The Four Pillars of AI Systems and the Data They Need — published on Medium. https://www.linkedin.com/pulse/four-pillars-ai-systems-andrew-madson-ueqjf https://www.linkedin.com/pulse/four-pillars-ai-systems-andrew-madson-ueqjf Thu, 12 Feb 2026 00:00:00 GMT LinkedIn AI Data Strategy The Four Pillars of AI Systems — published on LinkedIn. https://www.linkedin.com/pulse/ai-rise-transactional-lakehouse-andrew-madson-3yzaf https://www.linkedin.com/pulse/ai-rise-transactional-lakehouse-andrew-madson-3yzaf Wed, 11 Feb 2026 00:00:00 GMT LinkedIn AI Data Lakehouse AI and the Rise of the Transactional Lakehouse — published on LinkedIn. https://www.linkedin.com/pulse/interoperability-tax-challenge-building-everyone-andrew-madson-bheyf https://www.linkedin.com/pulse/interoperability-tax-challenge-building-everyone-andrew-madson-bheyf Tue, 10 Feb 2026 00:00:00 GMT LinkedIn Interoperability Data Engineering The Interoperability Tax — The Challenge of Building For Everyone — published on LinkedIn. https://www.linkedin.com/pulse/lance-vs-vortex-what-data-engineers-need-know-andrew-madson-ja3zc https://www.linkedin.com/pulse/lance-vs-vortex-what-data-engineers-need-know-andrew-madson-ja3zc Wed, 28 Jan 2026 00:00:00 GMT LinkedIn Data Formats Data Engineering Lance vs Vortex — What Data Engineers Need To Know — published on LinkedIn. https://medium.com/@andymadson/lance-vs-vortex-what-data-engineers-need-to-know-e728528ebd4c https://medium.com/@andymadson/lance-vs-vortex-what-data-engineers-need-to-know-e728528ebd4c Wed, 21 Jan 2026 00:00:00 GMT Medium Data Formats Data Engineering Lance vs Vortex: What Data Engineers Need to Know — published on Medium. https://medium.com/@andymadson/is-apache-iceberg-melting-c8fbb3771f52 https://medium.com/@andymadson/is-apache-iceberg-melting-c8fbb3771f52 Tue, 20 Jan 2026 00:00:00 GMT Medium Apache Iceberg Data Lakehouse Is Apache Iceberg Melting? — published on Medium. https://www.linkedin.com/pulse/apache-iceberg-melting-andrew-madson-9po4c https://www.linkedin.com/pulse/apache-iceberg-melting-andrew-madson-9po4c Sun, 18 Jan 2026 00:00:00 GMT LinkedIn Apache Iceberg Data Lakehouse Is Apache Iceberg Melting? — published on LinkedIn. https://www.linkedin.com/pulse/apache-polaris-130-everything-you-need-know-andrew-madson-2a3dc https://www.linkedin.com/pulse/apache-polaris-130-everything-you-need-know-andrew-madson-2a3dc Wed, 14 Jan 2026 00:00:00 GMT LinkedIn Apache Polaris Open Source Apache Polaris 1.3.0: EVERYTHING YOU NEED TO KNOW — published on LinkedIn. https://www.linkedin.com/pulse/bringing-vector-search-lakehouse-catalogs-lance-meets-andrew-madson-hg2qc https://www.linkedin.com/pulse/bringing-vector-search-lakehouse-catalogs-lance-meets-andrew-madson-hg2qc Sat, 10 Jan 2026 00:00:00 GMT LinkedIn Vector Search Apache Polaris Bringing Vector Search into Lakehouse Catalogs: Lance Meets Apache Polaris — published on LinkedIn. https://www.linkedin.com/pulse/data-modeling-commandments-10-rules-every-engineer-must-andrew-madson-j2szc https://www.linkedin.com/pulse/data-modeling-commandments-10-rules-every-engineer-must-andrew-madson-j2szc Wed, 07 Jan 2026 00:00:00 GMT LinkedIn Data Modeling Best Practices Data Modeling Commandments: 10 Rules Every Data Engineer Must Follow — published on LinkedIn. https://www.linkedin.com/pulse/apache-iceberg-scaling-petabytes-people-andrew-madson-st34c https://www.linkedin.com/pulse/apache-iceberg-scaling-petabytes-people-andrew-madson-st34c Thu, 18 Dec 2025 00:00:00 GMT LinkedIn Apache Iceberg Scalability Apache Iceberg — Scaling Petabytes & People — published on LinkedIn. https://www.linkedin.com/pulse/monthly-merge-report-november-2025-andrew-madson-4k9gc https://www.linkedin.com/pulse/monthly-merge-report-november-2025-andrew-madson-4k9gc Mon, 15 Dec 2025 00:00:00 GMT LinkedIn Open Source Community Monthly Merge Report — November 2025 — published on LinkedIn. https://www.fivetran.com/blog/data-pipeline-state-management-an-underappreciated-challenge https://www.fivetran.com/blog/data-pipeline-state-management-an-underappreciated-challenge Wed, 10 Dec 2025 00:00:00 GMT Fivetran Data Pipelines State Management Data Pipeline State Management: An Underappreciated Challenge — published on Fivetran. https://www.fivetran.com/blog/monthly-merge-report-for-oss-projects-november-2025 https://www.fivetran.com/blog/monthly-merge-report-for-oss-projects-november-2025 Fri, 28 Nov 2025 00:00:00 GMT Fivetran Open Source Community Monthly Merge Report for OSS Projects: November 2025 — published on Fivetran. https://www.linkedin.com/pulse/lakehouse-table-format-comparison-november-2025-andrew-madson-7rahc https://www.linkedin.com/pulse/lakehouse-table-format-comparison-november-2025-andrew-madson-7rahc Tue, 18 Nov 2025 00:00:00 GMT LinkedIn Data Lakehouse Table Formats Lakehouse Table Format Comparison (November 2025) — published on LinkedIn.