An Introduction to Information Theory

Graduate-level study for engineering students presents elements of modern probability theory, information theory with emphasis on its basic roots in probability theory, and elements of coding theory. It introduces basic concepts such as sets, sample space, random variables, information measure, and capacity, and is organized into parts covering memoryless discrete schemes, memoryless continuum, schemes with memory, and an outline of recent developments.