OpenAI Has No Moat, Google's Godfather of AI Quits & The Rise of Open Source LLMs | E13
In Episode 13 of This Day in AI We Discuss the Leaked Internal Google Document, "We Have No Moat, and Neither Does OpenAI", Discuss "The Godfather" of AI leaving Google, Discuss The Implications of Open Source LLM Advancement, Cover Open Assistant's Comparable Model to ChatGPT, OpenAI's Code Interrupter and Touch of Democratizing LLM Alignment.If you like this episode please consider subscribing and liking the episode to help others discover the podcast.TIMESTAMPS:====00:00 - Godfather of AI Quits Google Cold Open00:17 - Google & OpenAI Have No Moat: Advancement of Open Source LLMs21:13 - 'Godfather of AI' Quits Google30:54 - Open Assistant & Training LLMs using AI40:52 - What Increased Prompt Sizes Mean & Long Range Transformers50:49 - AI Agents, AI Disruption & Mark Zuckerberg's Agent Plan for MetaSOURCES====https://www.semianalysis.com/p/google-we-have-no-moat-and-neitherhttps://www.nytimes.com/2023/05/01/technology/ai-google-chatbot-engineer-quits-hinton.htmlhttps://www.theverge.com/2023/4/26/23699633/mark-zuckerberg-meta-generative-ai-chatbots-instagram-facebook-whatsapphttps://arxiv.org/pdf/2305.01625.pdfhttps://twitter.com/tanayj/status/1653243500354322436?s=46&t=uXHUN4Glah4CaV-g2czc6Qhttps://restofworld.org/2023/chatgpt-taking-kenya-ghostwriters-jobs/https://www.oneusefulthing.org/p/it-is-starting-to-get-strangehttps://www.nvidia.com/en-au/autonomous-machines/embedded-systems/https://open-assistant.io/chat