Adapters: the game changer for fine-tuning - Geoffrey Angus - The Data Scientist Show #084

I interviewed Geoffery Angus, ML team lead @Predibase to talk about why adapter-based training is a game changer. We started with an overview of fine-tuning and then discussed five reasons why adapters are the future of LLMs. Later we also shared a demo and answered questions from the live audience. Try fine-tuning for free: https://pbase.ai/GetStarted Geoffrey’s LinkedIn:https://www.linkedin.com/in/geoffreyangus Daliana's Twitter: ⁠https://twitter.com/DalianaLiu⁠ Daliana’s LinkedIn: ⁠https://www.linkedin.com/in/dalianaliu/⁠ Daliana's Twitter: ⁠https://twitter.com/DalianaLiu⁠ Daliana’s LinkedIn: ⁠https://www.linkedin.com/in/dalianaliu/ Geoffrey’s LinkedIn: https://www.linkedin.com/in/geoffreyangus Try finetuning for free: https://pbase.ai/GetStarted (00:00:00) Intro (00:01:19) What is Fine-tuning? (00:08:18) Utilizing Adapters for Finetuning Enhancement (00:09:50) 5 reasons why adapters are the future of LLMs (00:26:34) Common Mistakes in Adapters Usage (00:28:34) Training Your Own Adapter (00:32:23) Behind the Scenes of the Adapter Training Process (00:37:51) Config File Guidance for Fine-Tuning (00:39:41) Debugging Strategies for Suboptimal Fine-Tuning Results (00:42:23) User Queries: Creating a LoRa Adapter and Future Support (00:51:06) Key Takeaways and Recap

Om Podcasten

A deep dive into data scientists' day-to-day work, tools and models they use, how they tackle problems, and their career journeys. This podcast helps you grow a successful career in data science. Listening to an episode is like having lunch with an experienced mentor. Guests are data science practitioners from various industries, AI researchers, economists, and CTOs of AI companies. Host: Daliana Liu, an ex-Amazon senior data scientist with 180k followers on Linkedin. Join 20k subscribers at www.dalianaliu.com to learn more about data science, career, and this show. Twitter @DalianaLiu.