Bøger af Changho Suh

Information theory deals with mathematical laws that govern the flow, representation and transmission of information, just as the field of physics concerns laws that govern the behavior of the physical universe. The foundation was made in the context of communication while characterizing the fundamental limits of communication and offering codes (sometimes called algorithms) to achieve them.The most significant achievement of the field is the invention of digital communication which forms the basis of our daily-life digital products such as smart phones, laptops and any IoT devices. Recently it has also found important roles in a spotlight field that has been revolutionized during the past decades: data science.This book aims at demonstrating modern roles of information theory in a widening array of data science applications. The first and second parts of the book covers the core concepts of information theory: basic concepts on several key notions; and celebrated source and channel coding theorems which concern the fundamental limits of communication. The last part focuses on applications that arise in data science, including social networks, ranking, and machine learning.The book is written as a text for senior undergraduate and graduate students working on Information Theory and Communications, and it should also prove to be a valuable reference for professionals and engineers from these fields.

This book introduces the basic principles underlying the design and analysis of the digital communication systems that have heralded the information revolution. One major goal of the book is to demonstrate the role of the digital communication principles in a wide variety of data science applications, including community detection, computational biology, speech recognition and machine learning. One defining feature of this book is to make an explicit connection between the communication principles and data science problems, as well as to succinctly deliver the ¿story¿ of how the communication principles play a role for trending data science applications. All the key ¿plots¿ involved in the story are coherently developed with the help of tightly coupled exercise problem sets, and the associated fundamentals are explored mostly from first principles. Another key feature is that it includes programming implementation of a variety of algorithms inspired by fundamentals, together with a brief tutorial of the used programming tools. The implementation is based on Python and TensorFlow. This book does not follow a traditional book-style organization, but is streamlined via a series of lecture notes that are intimately related, centered around coherent storylines and themes. It serves as a textbook mainly for a junior- or senior-level undergraduate course, yet is also suitable for a first-year graduate course. Readers benefit from having a good background in probability and random processes, and basic familiarity with Python. But the background can be supplemented by almost self-contained materials, as well as by numerous exercise problems intended for elaborating on non-trivial concepts. In addition, Part III for data science applications should provide motivation and insights to students and even professional scientists who are interested in the field.