An Introduction To Information | Theory Fazlollah M Reza

Reza, F. M. (1994). An Introduction to Information Theory . Dover Publications. (Original work published 1961)

Reza sits between Shannon’s conceptual introduction and Cover & Thomas’s encyclopedic treatment. It is more mathematically demanding than MacKay but less encyclopedic. Fazlollah Reza’s An Introduction to Information Theory is a masterful, timeless exposition of the mathematical foundations of information theory. It does not chase trends; instead, it builds conceptual clarity from axioms up. For anyone who wants to truly understand entropy, channel capacity, and the deep links between information, probability, and statistics—rather than merely apply formulas—this book is a treasure. Its republication by Dover ensures that new generations can benefit from Reza’s lucid, rigorous vision.