The Reasoning Show

The Reasoning Show - Reasoning through the AI Revolution

The industry's leading AI podcast, explores how leaders think through AI, technology, and transformation. Each week founders, investors, and operators unpack the decisions behind the systems shaping modern business.

Hosts: Aaron Delp and Brian Gracely

All Episodes

The Reasoning Show

APIs and AI Gateways

February 14, 2024 • Massive Studios

0:00 | 33:29

Marco Palladino (@subnetmarco, CTO/Co-Founder @thekonginc) talks about the evolution of APIs, the need for consolidation and integration of AI APIs, and introduces the AI Gateway.

SHOW: 795

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to date with Enterprise Tech with theCUBE

SHOW NOTES:

Kong (homepage)
What is an AI Gateway?
Kong launches AI Gateway (Marco's blog on Kong homepage)
Kong introduces AI Gateway (Silicon Angle)
Hugging Face (AI model community)

Topic 1 - Welcome to the show. Before we dive into today’s discussion, tell us a little bit about your background at Kong and prior to Kong.

Topic 2 - Now that the world is obsessed with AI and AI Models, what roles do APIs continue to play for applications?

Topic 3 - You’ve lived through the API marketplace days. Do you see a lot of differences between API marketplaces and model marketplaces (e.g. like HuggingFace)?

Topic 4 - You’ve talked recently about the concept of an AI Gateway, somewhat as an evolution of an API Gateway. Walk us through this new concept.

Topic 5 - API Gateways can provide a lot of protection for known things by looking into various headers, security keys, and packet data. Can you imagine AI Gateways being able to have insights into model data to do things like Prompt Control, Hallucination Control, etc.?

Topic 6 - We’ve seen the merging of API Gateways (North/South) and Service Mesh (East/West) traffic as new application patterns emerged. Do you think we’ll see new traffic patterns again with AI traffic and AI model interactions?

FEEDBACK?