Modern Web Podcast S12E37- Java’s AI Evolution: Semantic Caching JVM, and GenAI Architectures with Theresa Mamarella & Brian Sam-Bodden
In this episode of the Modern Web Podcast, Danny Thompson, Director of Technology at This Dot Labs, hosts a conversation with Theresa Mammarella, JVM engineer at IBM, and Brian Sam-Bodden, Applied AI Engineer at Redis. They explore their talks at JCONF in Dallas, Texas, covering topics like GenAI architectures in the Java community and OpenJDK's Project Valhalla. Their conversation covers Java’s evolution, AI applications, semantic caching, and how these technologies are impacting development workflows and performance optimization. Chapters 00:00 - Introduction 01:00 - Brian on GenAI in the Java Community 01:47 - Java’s Safe Evolution Path 02:17 - Teresa on Project Valhalla 03:54 - Value Classes and Performance 04:33 - Brian on Semantic Caching 06:54 - Challenges of Rewording Prompts 09:15 - What is RAG Architecture? 11:34 - Java’s Role in AI 13:57 - Cost of LLMs and Caching Strategies 15:57 - Teresa on Java’s Future 18:22 - Learning Resources for Java Developers 20:44 - Addressing Misconceptions About Java 22:39 - Final Thoughts Follow Theresa Mammarella & Brian Sam on Social Media Theresa Mammarella Twitter: https://x.com/t_mammarella?lang=en Brian Sam-Bodden Twitter: https://x.com/bsbodden Theresa Mammarella Linkedin: https://www.linkedin.com/in/tmammarella/ Brian Sam-Bodden Linkedin: https://www.linkedin.com/in/sambodden/