Semantic Layers, OSI & AI: Why Context Beats Data Access

Data-Driven Podcast

Data-Driven Podcast
Semantic Layers, OSI & AI: Why Context Beats Data Access
Mar 25, 2026 Episode 40
AtScale

What does enterprise AI actually need to succeed: more data access or better context?

In this episode of the Data-Driven Podcast, AtScale CTO Dave Mariani sits down with Coginiti CTO Matthew Mullins to unpack one of the most important debates in modern data architecture: access vs. understanding. The conversation explores the rise of the semantic layer, the role of open semantics, and why initiatives like the Open Semantic Interchange (OSI) matter for the future of AI and analytics.

Matthew shares his journey from cognitive science and formal semantics into enterprise data, and how those foundations are becoming critical again in the age of AI. Together, Dave and Matthew break down:

  • Why inconsistent metrics (like “29 definitions of customer”) still plague enterprises
  • The real purpose of OSI and whether it should be an interchange format or a modeling standard
  • Why semantic layers are becoming core infrastructure for agentic AI and LLMs
  • How the Model Context Protocol (MCP) fits into the stack, and what it doesn’t solve
  • Why AI cannot replace human-defined business semantics
  • The shift from dashboards to AI-driven, ad hoc business intelligence

The key takeaway: LLMs don’t understand your data; they understand language about your data. Without a semantic layer to provide governed definitions, relationships, and context, AI systems will produce inconsistent or unreliable results.

If you're building AI-powered analytics, designing data platforms, or evaluating open standards like OSI, this conversation outlines where the industry is heading.

Learn more about AtScale’s universal semantic layer: https://www.atscale.com

Episode Artwork Semantic Layers, OSI & AI: Why Context Beats Data Access 31:47 Episode Artwork AI Needs Context: Semantic Layers, Metadata & Trust in 2026 33:28 Episode Artwork How MCP + Semantic Layers Turn LLMs Into Trusted BI Analysts 33:35 Episode Artwork The AI Frontier: Semantic Layers for Autonomous Agents with Jens Kröhnert 38:04 Episode Artwork Composable Analytics & the Future of the Semantic Layer: Building for the Age of AI Agents 31:30 Episode Artwork How Agentic AI and Semantic Layers Are Transforming Enterprise Analytics 34:37 Episode Artwork Open Source Semantics: Setting the Standard for Interoperability with Databricks and AtScale 31:06 Episode Artwork Introducing SML: The Open Standard for Seamless Semantic Layer Integration 18:20 Episode Artwork Revolutionizing Data: New Research on Natural Language Prompting with AtScale’s Semantic Layer and Generative AI 29:09 Episode Artwork The Power BI Evolution: An MVP’s Unfiltered Journey 30:28 Episode Artwork Navigating the Intersection of Semantics, AI, and Enterprise Innovation with Juan Sequeda 32:14 Episode Artwork Data Observability, Founders Journey and GenAI with Kunal Agarwal, CEO, Unravel Data 28:22 Episode Artwork Data Contracts with Andrew Jones, Principal Engineer, GoCardless 31:50 Episode Artwork Navigating Data Literacy: Insights from Jordan Morrow 37:59 Episode Artwork Leveraging Data as a Product: Strategies for Growth with Liat Ben-Zur 35:02 Episode Artwork Data and Analytics FinOps 48:28 Episode Artwork Leveraging Data Analytics and AI for Business Success with Richard Langlois, President at IT Architecture and Strategy 34:37 Episode Artwork Overcoming Challenges as a Woman in Tech and Data Analytics 31:32 Episode Artwork The Evolution of Data Lakes and the Entrepreneurial Journey with Justin Borgman 38:28 Episode Artwork Journey of Zenlytic, Semantic Layer, LLMs and the Future of Data-driven Insights 38:58 Episode Artwork Semantic Layer, Data Analytics and Artificial Intelligence with David Jayatillake, Co-Founder & CEO at Delphi Labs 31:15 Episode Artwork The Inflection Point of Generative AI, Analytics role in AI and AtScale <> Dataiku with 🦾Jepson Taylor 46:09 Episode Artwork Learn about Business intelligence (BI) and data warehousing, along with evolution of Power BI with Christopher Wagner 31:37 Episode Artwork Gaming Industry, Machine Learning, and ChatGPT with Carly Taylor, Machine Learning, at Call of Duty, Activision 31:46 Episode Artwork Data Mesh, Data Ownership, self-service data infrastructure with Sharon Richardson, Data+AI Strategist, Databricks 44:08