Gary Marcus on Rebooting AI
Gary Marcus, Professor Emeritus at NYU and co-founder of Robust.ai, discusses his recent book Rebooting AI: Building Artificial Intelligence We Can Trust. On this episode of Technology & Prose, Gary Marcus joins host Nikita Aggarwal to talk about the “AI chasm”— the gap between the goals and reality of artificial intelligence (1:40) GPT-3 and the limits of deep learning (4:38) how to build AI systems that have knowledge, reasoning and understanding (9:14) the politics of AI research (and more on the limits of GPT-3) (16:00) innate knowledge in machines and the need for a hybrid approach to building AI (33:25) the Montreal AI Debates, the System 1/ System 2 analogy and lessons from developmental psychology (37:04) and Gary's new venture, Robust.ai (43:15) . References Marcus, Deep Learning: a Critical Appraisal Goyal and Bengio, Inductive Biases for Deep Learning of Higher-Level Cognition LeCun, Hinton, Bengio, Deep Learning Kahneman, Thinking Fast and Slow Montreal AI debates https://montrealartificialintelligence.com/aidebate/ ; https://montrealartificialintelligence.com/aidebate2.html Marcus, Guitar Zero: The Science of Learning to be Musical GPT-3 Open AI’s GPT-3 model Marcus and Davis on GPT-3 in MIT Tech Review Guardian article ‘written’ by GPT-3 Yann LeCun on GPT-3 DeepMind Alphafold Mastering the game of Go in the absence of human knowledge Recorded on January 28th 2021