Information Theory is one of the few scientific field to have an identifiable. It provides the opportunity to study the social, political and technological interactions that have helped guide its development and define its trajectory and gives us insight into how a new field evolves.
Information theory was introduced by Shannon in the late 1940s as a mathematical theory to understand and quantify the limits of compressing and reliably storing/communicating data. Since its inception, in addition to its pivotal role in digital communications, the subject has broadened to find applications in many different areas of science and engineering. In recent years, information-theoretic techniques and intuition have also been playing an increasingly prominent role in theoretical computer science. This course will cover the basic notions in information theory, followed by a sample of diverse applications in theoretical computer science and related mathematics that use techniques from information theory.
