EP29: Meta's Code Llama, Unnatural Instruction, Phishing Our Mother & OpenAI's GPT3.5 Fine Tuning

This week, the Zuck strikes again - Meta unveils a state of the art AI code generator to challenge OpenAI's dominance. We explore the implications of AI models training themselves, and how it could accelerate capabilities. Then we put 11 labs' multilingual speech synthesis to the test, using it to generate a fake phishing call on our mother. Don't miss our scandalous experiments pushing AI to its limits in this jam-packed episode!If you like the pod, please consider subbing, liking, commenting etc. xoxCHAPTERS:=====00:00 - Rehearsal of Phishing Our Mother (Cold Open)00:19 - Meta's Code Llama08:24 - Unnatural Instruction to Train AI Models15:06 - Why Didn't Meta Release the Unnatural Instruction Code Llama Model? The Sparks of AGI?16:50 - Evolution of GPT: Is Unnatural Instruction The Next Evolution of Models?23:04 - DeepMind's Reinforced Self-Training ReST for Language Modeling paper and thoughts on future models36:09 - Fine Tuning GPT-3.5 Turbo Announced by OpenAI: Should You Just Fine Tune Open Source?44:05 - ElevenLabs Out of Beta and Multilingual v2: Explained by AI Us.48:12 - Chris Tried to Figure Out AI Phishing53:03 - Rehearsing Phishing Our Mother Call & Implications of This AI Tech59:43 - How Much We Lost Not Investing in NVIDIA1:01:29 - AI Bros Give Investment AdviceSOURCES:======https://ai.meta.com/blog/code-llama-large-language-model-coding/https://www.theinformation.com/articles/metas-next-ai-attack-on-openai-free-code-generating-softwarehttps://twitter.com/emollick/status/1694793231727210579?s=46&t=uXHUN4Glah4CaV-g2czc6Qhttps://minimaxir.com/2023/08/stable-diffusion-xl-wrong/https://twitter.com/abacaj/status/1679996952560246786/photo/1https://openai.com/blog/gpt-3-5-turbo-fine-tuning-and-api-updateshttps://arstechnica.com/ai/2023/08/how-chatgpt-turned-generative-ai-into-an-anything-tool/https://elevenlabs.io/blog/multilingualv2/https://www.businessinsider.com/nvidia-technology-spending-wave-build-out-google-meta-oracle-gpu-2023-8PAPERS:======https://arxiv.org/pdf/2212.09689.pdfhttps://arxiv.org/pdf/2308.08998.pdf

Om Podcasten

Join Michael and Chris Sharkey, two proudly average tech enthusiasts, as they stumble through the world of artificial intelligence with all the grace of a robot learning to dance. This (sometimes weekly*) podcast delivers an hour-long conversation about their thoroughly middle-of-the-road adventures with AI. No PhDs. No Silicon Valley insights. Just two guys with enough technical knowledge to be dangerous, sharing their unexceptional yet entertaining experiences with AI tools and technology. Subscribe now to hear: • Mediocre hot takes on AI developments • Stories of AI experiments gone adequately okay • The most average advice you'll ever need • Two Sharkeys trying their best to sound smart about algorithms • Childish AI prank calls that somehow fool everybody • Attempts at using AI for phishing attacks on their mother • "Chart-topping" AI songs according to the brothers Join our perfectly mediocre community where being average at AI is celebrated, questions are encouraged, and learning through mistakes is our specialty. Because let's face it - most of us are figuring this out as we go along. New episodes drop whenever we remember to record them. 🎙️ Proudly supported by Simtheory.ai