Matthew Pulsipher

Productizing Decisional AI

In this episode Darren interviews his son Matthew Pulsipher about productizing decisional AI. Matthew has recently modernized and product development pipeline to include decisional AI in his product development.

CrowdStrike Outage Exposes Cybersecurity Flaws

The CrowdStrike outage over the weekend exposed major flaws in our approach to CyberSeurity, Software Engineering and System Architecture. Darren is joined with returning guest Matthew Pulsipher to discuss the implications of this weekends events.

GenAI + RAG + Apple Mac = Private GenAI

In this conversation, Matthew Pulsipher discusses the intricacies of setting up a private generative AI system, emphasizing the importance of understanding its components, including models, servers, and front-end applications. He elaborates on the significance of context in AI responses and introduces the concept of Retrieval-Augmented Generation (RAG) to enhance AI performance. The discussion also covers tuning embedding models, the role of quantization in AI efficiency, and the potential for running private AI systems on Macs, highlighting cost-effective hosting solutions for businesses.

Takeaways

• Setting up a private generative AI requires understanding various components.
• Data leakage is not a concern with private generative AI models.
• Context is crucial for generating relevant AI responses.
• Retrieval-Augmented Generation (RAG) enhances AI's ability to provide context.
• Tuning the embedding model can significantly improve AI results.
• Quantization reduces model size but may impact accuracy.
• Macs are uniquely positioned to run private generative AI efficiently.
• Cost-effective hosting solutions for private AI can save businesses money.
• A technology is advancing towards mobile devices and local processing.

Chapters

00:00 Introduction to Matthew's Superpowers and Backstory 07:50 Enhancing Context with Retrieval-Augmented Generation (RAG) 18:25 Understanding Quantization in AI Models 23:31 Running Private Generative AI on Macs 29:20 Cost-Effective Hosting Solutions for Private AI