AI Portfolio Podcast

Paige Bailey: Future of Coding, Gen AI, Google AI Landscape & Advice - AI Portfolio Podcast

December 27, 2023 Mark Moyou, PhD Season 1 Episode 2
Paige Bailey: Future of Coding, Gen AI, Google AI Landscape & Advice - AI Portfolio Podcast
AI Portfolio Podcast
More Info
AI Portfolio Podcast
Paige Bailey: Future of Coding, Gen AI, Google AI Landscape & Advice - AI Portfolio Podcast
Dec 27, 2023 Season 1 Episode 2
Mark Moyou, PhD

Paige Bailey, a Lead Product Manager for Generative Models at Google DeepMind, shares her expertise in guiding teams training very large language models. She focuses on training code generation models, one of the industry's most valuable types of LLMs. Paige has held multiple leadership positions at Google, Microsoft, and Github. 

In this interview, you will understand the responsibilities of a top Product Manager at a forefront AI company and how you can navigate your career from a data position to a product manager position. 

📲 Paige Bailey Socials:
LinkedIn: https://www.linkedin.com/in/dynamicwebpaige/
Twitter: https://twitter.com/DynamicWebPaige
https://github.com/dynamicwebpaige

📲 Mark Moyou, PhD Socials:
LinkedIn: https://www.linkedin.com/in/markmoyou/
Twitter: https://twitter.com/MarkMoyou

See other interviews and talks from Paige:
- Generative Models: https://www.youtube.com/live/wqkKResXWB8?si=Vxwspw_TXGs9XoG9&t=2356
- Learning From Machine Learning - https://youtu.be/BNz2yFVppts?si=aA2hjphacfDP2taW
- Whats AI by Louis Bouchard - https://youtu.be/y5nxMnTtbD4?si=_eeADH9ZFAE-W6vy

📗 Chapters
00:00 Intro
02:19 Product Manager at Google DeepMind
04:12 Is LLM a fad?
06:35 Large VS Small LLM
08:37 Multimodal Model
11:06 Generative AI for Code Generation in Enterprise
14:25 Tokenization Approaches for Code Generation
20:30 Data Poisoning
23:31 Nervousness during Pre-Training Run
26:27 Best Practices for Fine-Tuning and Instruction Training
28:14 When to Redo a Training Run?
30:15 Obsession with Generative Models
34:18 Fine-Tuning Internal Codebase
36:40 Future of Software Engineers
39:30 LLM for Data Leaders
40:58 Gen AI for Small and Medium Enterprise
42:45 How do I Convince My Boss to Adopt Gen AI?
45:20 Evolution of Data Science
48:00 Gen AI for Investors
50:52 Workspace Shrinkage
53:06 Gen AI Impact on Academia
57:16 Advice for Web3 Influencers
01:01:52 Career Optimization Function
01:05:13 Switching to Product Management
01:07:05 Criteria for Changing the Job
01:10:06 Consuming AI Research Content
01:11:57 Top 1% Data Scientists
01:12:41 Imposter Syndrome
01:13:41 Unfair Advantage
01:17:00 Book Recommendations
01:20:11 Habits to Make Progress
01:21:40 Two Meals
01:23:00 Advice for High Schoolers, College Students, & Professionals
01:24:59 What do you want people to remember about you?

Show Notes

Paige Bailey, a Lead Product Manager for Generative Models at Google DeepMind, shares her expertise in guiding teams training very large language models. She focuses on training code generation models, one of the industry's most valuable types of LLMs. Paige has held multiple leadership positions at Google, Microsoft, and Github. 

In this interview, you will understand the responsibilities of a top Product Manager at a forefront AI company and how you can navigate your career from a data position to a product manager position. 

📲 Paige Bailey Socials:
LinkedIn: https://www.linkedin.com/in/dynamicwebpaige/
Twitter: https://twitter.com/DynamicWebPaige
https://github.com/dynamicwebpaige

📲 Mark Moyou, PhD Socials:
LinkedIn: https://www.linkedin.com/in/markmoyou/
Twitter: https://twitter.com/MarkMoyou

See other interviews and talks from Paige:
- Generative Models: https://www.youtube.com/live/wqkKResXWB8?si=Vxwspw_TXGs9XoG9&t=2356
- Learning From Machine Learning - https://youtu.be/BNz2yFVppts?si=aA2hjphacfDP2taW
- Whats AI by Louis Bouchard - https://youtu.be/y5nxMnTtbD4?si=_eeADH9ZFAE-W6vy

📗 Chapters
00:00 Intro
02:19 Product Manager at Google DeepMind
04:12 Is LLM a fad?
06:35 Large VS Small LLM
08:37 Multimodal Model
11:06 Generative AI for Code Generation in Enterprise
14:25 Tokenization Approaches for Code Generation
20:30 Data Poisoning
23:31 Nervousness during Pre-Training Run
26:27 Best Practices for Fine-Tuning and Instruction Training
28:14 When to Redo a Training Run?
30:15 Obsession with Generative Models
34:18 Fine-Tuning Internal Codebase
36:40 Future of Software Engineers
39:30 LLM for Data Leaders
40:58 Gen AI for Small and Medium Enterprise
42:45 How do I Convince My Boss to Adopt Gen AI?
45:20 Evolution of Data Science
48:00 Gen AI for Investors
50:52 Workspace Shrinkage
53:06 Gen AI Impact on Academia
57:16 Advice for Web3 Influencers
01:01:52 Career Optimization Function
01:05:13 Switching to Product Management
01:07:05 Criteria for Changing the Job
01:10:06 Consuming AI Research Content
01:11:57 Top 1% Data Scientists
01:12:41 Imposter Syndrome
01:13:41 Unfair Advantage
01:17:00 Book Recommendations
01:20:11 Habits to Make Progress
01:21:40 Two Meals
01:23:00 Advice for High Schoolers, College Students, & Professionals
01:24:59 What do you want people to remember about you?