Data Science #5 - "A Mathematical Theory of Communication" (1948), Shannon, C. E. Part - 3

Shannon, Claude Elwood. "A mathematical theory of communication." The Bell system technical journal 27.3 (1948): 379-423. Part 3/3. The paper fundamentally reshapes how we understand communication. The paper introduces a formal framework for analyzing communication systems, addressing the transmission of information with and without noise. Key concepts include the definition of information entropy, the logarithmic measure of information, and the capacity of communication channels. In the third part we go over the Fundamental theorem of the noisy and noiseless channel! Full breakdown of the paper with math and python code is at our website: https://datasciencedecodedpodcast.com/

Om Podcasten

We discuss seminal mathematical papers (sometimes really old 😎 ) that have shaped and established the fields of machine learning and data science as we know them today. The goal of the podcast is to introduce you to the evolution of these fields from a mathematical and slightly philosophical perspective. We will discuss the contribution of these papers, not just from pure a math aspect but also how they influenced the discourse in the field, which areas were opened up as a result, and so on. Our podcast episodes are also available on our youtube: https://youtu.be/wThcXx_vXjQ?si=vnMfs