Information theory is the mathematical treatment of the concepts, parameters and rules governing the transmission of messages through communication systems. This book is an excellent introduction to the mathematics underlying the theory. I like the description of channels with memory in particular. The branch of applied mathematics and cybernetics related to the mathematical description and estimation of the quality of the transmission, preservation, extraction, and classification of information. Professor emeritus of mathematics at the university of illinois, robert ash is the author of three other dover books. The mathematical theory of information jan kahre springer. Among the numerous delights readers will learn about as they dip into this inviting anthology. Yes, information theory is a branch of mathematics, although its practitioners are often found in departments of electrical and computer engineering or computer science.
The notion of entropy, which is fundamental to the whole topic of this book. For a scientist investigating bugs, his microscope is his information channel. An introduction to information theory dover books on. The 100 best information theory books recommended by jeff atwood, andrew chen. It was founded by claude shannon toward the middle of the twentieth century and has since then evolved into a vigorous branch of mathematics fostering. The books he wrote on mathematical foundations of information theory, statistical mechanics and quantum statistics are still in print in english translations, published by dover. Written for an engineering audience, this book has a threefold purpose.
Information theory is a broad and deep mathematical theory, with equally. Chapter 1, about information the mathematical theory of information. Free information theory books download ebooks online. A tutorial introduction a tutorial introduction book, band 3. Indeed, even in shannons day many books and articles appeared that. Among the topics covered are noiseless coding, the discrete memoryless channel, effort correcting codes, information sources, channels with memory, and. Like william feller and richard feynman he combines a complete mastery of his subject with an ability to explain clearly without sacrificing mathematical rigour. The remainder of the book is devoted to coding theory and is independent of the information theory portion of the book. This law is supported by two independent arguments. Information theory studies the quantification, storage, and communication of information.
Developed by claude shannon and norbert wiener in the late 1940s, information theory, or statistical communication theory, deals with the theoretical underpinnings of a wide range of communication devices. This is a graduatelevel introduction to mathematics of information theory. This suggests a need for a book that not only introduces the basic concepts of quantum information theory, but also presents in detail some of the. Symbols, signals and noise dover books on mathematics by john r. Most closely associated with the work of the american electrical engineer claude shannon in the mid20th century, information theory is chiefly of interest to communication engineers, though some of the concepts have been adopted and used in such fields as psychology and linguistics. Shannons main result, the noisychannel coding theorem showed that, in the. After a brief discussion of general families of codes, the author discusses linear codes including the hamming, golary, the reedmuller codes, finite fields, and cyclic codes including the bch, reedsolomon, justesen, goppa, and quadratic residue codes. Mathematical foundations of information theory dover books on. A mathematical theory of communication harvard university.
Information theory, a mathematical representation of the conditions and parameters affecting the transmission and processing of information. The first comprehensive introduction to information theory, this book places the work begun by shannon and continued by mcmillan, feinstein, and khinchin on a rigorous mathematical basis. Information theory, a mathematical representation of the conditions and. Symbols, signals and noise dover books on mathematics englisch taschenbuch 1. Information theory dover books on mathematics ebook. This mathematical theory of information is explored in fourteen chapters. Mathematical foundations of information theory dover. Then, following the main results, the channel and source coding. Maths infinite mysteries and beauty unfold in this followup to the bestselling the science book. Theory information and coding 2nd edition discrete mathematics. Most closely associated with the work of the american electrical engineer claude shannon in the mid20th century, information theory is chiefly of interest to communication engineers, though some of the concepts have been adopted and used in such fields as. Everyday low prices and free delivery on eligible orders. There is a short and elementary overview introducing the reader to the concept of coding. Buy information theory dover books on mathematics new edition by ash, robert isbn.
Mathematical foundations of information theory dover books on mathematics khinchin, a. For the first time, mathematicians, statisticians, physicists, cyberneticists, and communications engineers are offered a lucid, comprehensive introduction to this rapidly growing field. This note will cover both classical and modern topics, including information entropy, lossless data compression, binary hypothesis testing, channel coding, and lossy data compression. Information theory an overview sciencedirect topics. Beginning millions of years ago with ancient ant odometers and moving through time to our modernday quest for new dimensions, it covers 250 milestones in mathematical history.
Quantum systems, channels, information a mathematical. The book explains with minimum amount of mathematics what information. Shannons work defined communication channels and showed how to assign a capacity to. Symbols, signals and noise dover books on mathematics. There are excellent textbooks on classical information theory, aimed at students of.
34 1473 670 195 1255 1368 1292 682 1568 111 903 1248 1133 1555 213 622 52 454 1242 826 893 1027 1057 624 1555 424 655 1176 988 532 1054 436 896 115 1187 254 981 1405 797 368 952 327 148 1394