Databases for AI Workloads
Infinite ML with Prateek Joshi
More Info
Infinite ML with Prateek Joshi
Databases for AI Workloads
Jul 23, 2024
Prateek Joshi

Tim Tully is a partner at Menlo Ventures, a VC firm that has invested in companies like Uber, Anthropic, Pinecone, Benchling, Chime, Carta, Recursion, and more. He was previously the CTO of Splunk, a publicly traded company that was acquired by Cisco for $28 billion. Prior to that, he was the VP of Engineering at Yahoo for 14 years.

Tim's favorite book: Infinite Jest (Author: David Foster Wallace)

(00:01) Introduction
(00:07) Evolution of Databases
(03:17) Enduring Business Models in Data Management
(04:41) Challenges and Trade-offs in Database Choices
(06:20) Modern Database Architecture
(09:06) Separation of Storage and Compute
(10:35) Role of Indexing in LLM Applications
(13:20) Handling Different Types of Data in Databases
(14:50) Distributed Databases Explained
(16:20) Real-time Data Handling and Requirements
(18:53) Architecting Data Infrastructure for AI
(21:29) ETL in Modern Data Infrastructure
(24:53) AI's Role in Database Optimization
(27:17) Network Architecture
(30:13) Hardware Improvements and Database Performance
(33:35) Technological Breakthroughs and Investment Opportunities
(35:11) Rapid Fire Round

--------
Where to find Prateek Joshi:

Newsletter: https://prateekjoshi.substack.com 
Website: https://prateekj.com 
LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 
Twitter: https://twitter.com/prateekvjoshi 

Episode Artwork Databases for AI Workloads 37:29 Episode Artwork Breaking New Ground With Collaborative Robots 49:22 Episode Artwork Building Floor Cleaning Robots 42:24 Episode Artwork How to extract intelligence from speech data with AI 44:56 Episode Artwork Designing Antibodies with AI 34:52 Episode Artwork The Long Tail of AI: Understanding and Resolving Edge Cases 37:53 Episode Artwork How Symbolic AI is Transforming Critical Infrastructure 38:08 Episode Artwork AI Disruption: Startups vs Incumbents in the Tech Stack 46:57 Episode Artwork Unpacking AI Startups: Metrics, Playbooks, and the Future 33:09 Episode Artwork Automated Evaluation of LLMs 36:03 Episode Artwork Investing In AI-first Startups 33:28 Episode Artwork AI's Role In Physics, Chemistry, and Beyond 39:27 Episode Artwork Generative AI for Coding 32:03 Episode Artwork Building Robots That Can Cook 43:55 Episode Artwork Discovering New Materials With AI 39:35 Episode Artwork Designing Printed Circuit Boards With AI 39:26 Episode Artwork Algorithmic Data Curation 41:10 Episode Artwork Modifying Speech Accents In Real Time With AI 34:34 Episode Artwork Voice AI Agents 40:08 Episode Artwork MANG VC "Round Trip" Phenomenon in AI 40:38 Episode Artwork AI x Future of Work 33:14 Episode Artwork LLM Data Frontiers 33:45 Episode Artwork AI in Defense 47:42 Episode Artwork Building and Investing in Consumer AI 40:51 Episode Artwork Open Source x Health AI 42:19