# Information Theory

Canonical: https://www.synapsebooks.app/subjects/information-theory

Kind: subject

Description: Communication, codes, and error correction.

Works on this shelf: 114

Markdown: https://www.synapsebooks.app/subjects/information-theory/markdown

Machine records: https://www.synapsebooks.app/api/discovery/works?subject=information-theory

## Works on this shelf

- [A Block-Sorting Lossless Data Compression Algorithm](https://www.synapsebooks.app/catalog/a-block-sorting-lossless-data-compression-algorithm): Michael Burrows & David Wheeler. Book. Supplied bibliography entry.
- [A Digital Fountain Approach to Reliable Distribution of Bulk Data](https://www.synapsebooks.app/catalog/a-digital-fountain-approach-to-reliable-distribution-of-bulk-data): John Byers et al.. Book. Supplied bibliography entry.
- [A Formal Theory of Inductive Inference, Part I](https://www.synapsebooks.app/catalog/a-formal-theory-of-inductive-inference-part-i): Ray J. Solomonoff. Paper. Paper listed in Volume III under AI & Machine Learning.
- [A Mathematical Theory of Communication](https://www.synapsebooks.app/catalog/a-mathematical-theory-of-communication): Claude E. Shannon. Paper. Information, entropy, and channel capacity in a mathematical theory of communication.
- [A Method for the Construction of Minimum-Redundancy Codes](https://www.synapsebooks.app/catalog/a-method-for-the-construction-of-minimum-redundancy-codes): David Huffman. Book. Supplied bibliography entry.
- [A Technique for High-Performance Data Compression (LZW)](https://www.synapsebooks.app/catalog/a-technique-for-high-performance-data-compression-lzw): Terry Welch. Book. Supplied bibliography entry.
- [A Theory of Universal Artificial Intelligence based on Algorithmic Complexity](https://www.synapsebooks.app/catalog/a-theory-of-universal-artificial-intelligence-based-on-algorithmic-complexity): Marcus Hutter. Paper. Paper listed in Volume III under AI & Machine Learning.
- [A Tutorial on Reed-Solomon Coding for Fault-Tolerance](https://www.synapsebooks.app/catalog/a-tutorial-on-reed-solomon-coding-for-fault-tolerance): James Plank. Book. Supplied bibliography entry.
- [A Unified Approach to the Definition of Random Sequences](https://www.synapsebooks.app/catalog/a-unified-approach-to-the-definition-of-random-sequences): Claus-Peter Schnorr. Book. Supplied bibliography entry.
- [A Universal Algorithm for Sequential Data Compression (LZ77)](https://www.synapsebooks.app/catalog/a-universal-algorithm-for-sequential-data-compression-lz77): Jacob Ziv & Abraham Lempel. Book. Supplied bibliography entry.
- [Adaptive Variable-Length Coding for Efficient Compression of Spacecraft Television Data](https://www.synapsebooks.app/catalog/adaptive-variable-length-coding-for-efficient-compression-of-spacecraft-television-data): Robert Rice & James Plaunt. Book. Supplied bibliography entry.
- [Adaptive Weighing of Context Models for Lossless Data Compression](https://www.synapsebooks.app/catalog/adaptive-weighing-of-context-models-for-lossless-data-compression): Matt Mahoney. Book. Supplied bibliography entry.
- [Algebraic Coding Theory](https://www.synapsebooks.app/catalog/algebraic-coding-theory): Elwyn Berlekamp. Book. Supplied bibliography entry.
- [Algebraic Soft-Decision Decoding of Reed-Solomon Codes](https://www.synapsebooks.app/catalog/algebraic-soft-decision-decoding-of-reed-solomon-codes): Ralf Koetter & Alexander Vardy. Book. Supplied bibliography entry.
- [Algorithmic Information Theory](https://www.synapsebooks.app/catalog/algorithmic-information-theory): Gregory Chaitin. Book. Supplied bibliography entry.
- [An Algorithm for Computing the Capacity of Arbitrary Discrete Memoryless Channels](https://www.synapsebooks.app/catalog/an-algorithm-for-computing-the-capacity-of-arbitrary-discrete-memoryless-channels): Suguru Arimoto. Book. Supplied bibliography entry.
- [An Information Measure for Classification](https://www.synapsebooks.app/catalog/an-information-measure-for-classification): Chris Wallace & David Boulton. Book. Supplied bibliography entry.
- [An Introduction to Arithmetic Coding](https://www.synapsebooks.app/catalog/an-introduction-to-arithmetic-coding): Glen Langdon. Book. Supplied bibliography entry.
- [An Introduction to Kolmogorov Complexity and Its Applications](https://www.synapsebooks.app/catalog/an-introduction-to-kolmogorov-complexity-and-its-applications): Ming Li & Paul Vitányi. Book. Supplied bibliography entry.
- [Arithmetic Coding](https://www.synapsebooks.app/catalog/arithmetic-coding): Jorma Rissanen & Glen Langdon. Book. Supplied bibliography entry.
- [Arithmetic Coding for Data Compression](https://www.synapsebooks.app/catalog/arithmetic-coding-for-data-compression): Ian Witten, Radford Neal, John Cleary. Book. Supplied bibliography entry.
- [Asymmetric Numeral Systems](https://www.synapsebooks.app/catalog/asymmetric-numeral-systems): Richard Duda. Book. Supplied bibliography entry.
- [Block Sorting Text Compression](https://www.synapsebooks.app/catalog/block-sorting-text-compression): Peter Fenwick. Book. Supplied bibliography entry.
- [Brotli Compressed Data Format (RFC 7932)](https://www.synapsebooks.app/catalog/brotli-compressed-data-format-rfc-7932): Jyrki Alakuijala & Zoltan Szabadka. Book. Supplied bibliography entry.
- [bzip2](https://www.synapsebooks.app/catalog/bzip2): Julian Seward. Book. Supplied bibliography entry.
- [Channel Polarization](https://www.synapsebooks.app/catalog/channel-polarization): Erdal Arıkan. Book. Supplied bibliography entry.
- [Coding and Information Theory](https://www.synapsebooks.app/catalog/coding-and-information-theory): Richard Hamming. Book. Supplied bibliography entry.
- [Coding for Errors and Erasures in Random Network Coding](https://www.synapsebooks.app/catalog/coding-for-errors-and-erasures-in-random-network-coding): Ralf Kötter & Frank Kschischang. Book. Supplied bibliography entry.
- [Coding for Noisy Channels](https://www.synapsebooks.app/catalog/coding-for-noisy-channels): Peter Elias. Book. Supplied bibliography entry.
- [Coding Theorems for a Discrete Source with a Fidelity Criterion](https://www.synapsebooks.app/catalog/coding-theorems-for-a-discrete-source-with-a-fidelity-criterion): Claude Shannon. Book. Supplied bibliography entry.
- [Communication Theory of Secrecy Systems](https://www.synapsebooks.app/catalog/communication-theory-of-secrecy-systems): Claude E. Shannon. Paper. Paper listed in Volume III under Networks, Cryptography & Digital Money.
- [Compression of Individual Sequences via Variable-Rate Coding (LZ78)](https://www.synapsebooks.app/catalog/compression-of-individual-sequences-via-variable-rate-coding-lz78): Jacob Ziv & Abraham Lempel. Book. Supplied bibliography entry.
- [Computation of Channel Capacity and Rate-Distortion Functions](https://www.synapsebooks.app/catalog/computation-of-channel-capacity-and-rate-distortion-functions): Richard Blahut. Book. Supplied bibliography entry.
- [Concatenated Codes](https://www.synapsebooks.app/catalog/concatenated-codes): G. David Forney. Book. Supplied bibliography entry.
- [Cool-Chic](https://www.synapsebooks.app/catalog/cool-chic): Théo Ladune et al.. Book. Supplied bibliography entry.
- [Data Compression](https://www.synapsebooks.app/catalog/data-compression): Debra Lelewer & Daniel Hirschberg. Book. Supplied bibliography entry.
- [Data Compression Explained](https://www.synapsebooks.app/catalog/data-compression-explained): Matt Mahoney. Book. Supplied bibliography entry.
- [Data Compression Using Adaptive Coding and Partial String Matching](https://www.synapsebooks.app/catalog/data-compression-using-adaptive-coding-and-partial-string-matching): John Cleary & Ian Witten. Book. Supplied bibliography entry.
- [Data Compression via Textual Substitution](https://www.synapsebooks.app/catalog/data-compression-via-textual-substitution): James Storer & Thomas Szymanski. Book. Supplied bibliography entry.
- [Data Compression: The Complete Reference](https://www.synapsebooks.app/catalog/data-compression-the-complete-reference): David Salomon. Book. Supplied bibliography entry.
- [Deep Contextual Video Compression](https://www.synapsebooks.app/catalog/deep-contextual-video-compression): Jiahao Li, Bin Li, Yan Lu. Book. Supplied bibliography entry.
- [Density Modeling of Images Using a Generalized Normalization Transformation](https://www.synapsebooks.app/catalog/density-modeling-of-images-using-a-generalized-normalization-transformation): Johannes Ballé, Valero Laparra, Eero Simoncelli. Book. Supplied bibliography entry.
- [Design and Analysis of Dynamic Huffman Codes](https://www.synapsebooks.app/catalog/design-and-analysis-of-dynamic-huffman-codes): Jeffrey Vitter. Book. Supplied bibliography entry.
- [Digital Fountains](https://www.synapsebooks.app/catalog/digital-fountains): Michael Mitzenmacher. Book. Supplied bibliography entry.
- [DVC](https://www.synapsebooks.app/catalog/dvc): Lu et al.. Book. Supplied bibliography entry.
- [Dynamic Huffman Coding](https://www.synapsebooks.app/catalog/dynamic-huffman-coding): Donald E. Knuth. Book. Supplied bibliography entry.
- [Effective Erasure Codes for Reliable Computer Communication Protocols](https://www.synapsebooks.app/catalog/effective-erasure-codes-for-reliable-computer-communication-protocols): Luigi Rizzo. Book. Supplied bibliography entry.
- [Efficient Universal Lossless Data Compression Algorithms](https://www.synapsebooks.app/catalog/efficient-universal-lossless-data-compression-algorithms): En-Hui Yang & John Kieffer. Book. Supplied bibliography entry.
- [Elements of Information Theory](https://www.synapsebooks.app/catalog/elements-of-information-theory): Thomas Cover & Joy Thomas. Book. Supplied bibliography entry.
- [End-to-End Optimized Image Compression](https://www.synapsebooks.app/catalog/end-to-end-optimized-image-compression): Johannes Ballé et al.. Book. Supplied bibliography entry.
- [Error Control Coding](https://www.synapsebooks.app/catalog/error-control-coding): Shu Lin & Daniel Costello. Book. Supplied bibliography entry.
- [Estimation and Inference by Compact Coding](https://www.synapsebooks.app/catalog/estimation-and-inference-by-compact-coding): Chris Wallace & Peter Freeman. Book. Supplied bibliography entry.
- [Finite State Entropy](https://www.synapsebooks.app/catalog/finite-state-entropy): Yann Collet. Book. Supplied bibliography entry.
- [Full Resolution Image Compression with Recurrent Neural Networks](https://www.synapsebooks.app/catalog/full-resolution-image-compression-with-recurrent-neural-networks): George Toderici et al.. Book. Supplied bibliography entry.
- [Generalized Kraft Inequality and Arithmetic Coding](https://www.synapsebooks.app/catalog/generalized-kraft-inequality-and-arithmetic-coding): Jorma Rissanen. Book. Supplied bibliography entry.
- [Generative Adversarial Networks for Extreme Learned Image Compression](https://www.synapsebooks.app/catalog/generative-adversarial-networks-for-extreme-learned-image-compression): Eirikur Agustsson et al.. Book. Supplied bibliography entry.
- [Grammar-Based Codes](https://www.synapsebooks.app/catalog/grammar-based-codes): John Kieffer & En-Hui Yang. Book. Supplied bibliography entry.
- [High-Fidelity Generative Image Compression](https://www.synapsebooks.app/catalog/high-fidelity-generative-image-compression): Fabian Mentzer et al.. Book. Supplied bibliography entry.
- [Identifying Hierarchical Structure in Sequences (Sequitur)](https://www.synapsebooks.app/catalog/identifying-hierarchical-structure-in-sequences-sequitur): Craig Nevill-Manning & Ian Witten. Book. Supplied bibliography entry.
- [Implementing the Burrows-Wheeler Transform](https://www.synapsebooks.app/catalog/implementing-the-burrows-wheeler-transform): Bernhard Balkenhol et al.. Book. Supplied bibliography entry.
- [Implementing the PPM Data Compression Scheme](https://www.synapsebooks.app/catalog/implementing-the-ppm-data-compression-scheme): Alistair Moffat. Book. Supplied bibliography entry.
- [Improved Decoding of Reed-Solomon and Algebraic-Geometry Codes](https://www.synapsebooks.app/catalog/improved-decoding-of-reed-solomon-and-algebraic-geometry-codes): Venkatesan Guruswami & Madhu Sudan. Book. Supplied bibliography entry.
- [Improved Lossy Image Compression with Priming and Spatially Adaptive Bit Rates](https://www.synapsebooks.app/catalog/improved-lossy-image-compression-with-priming-and-spatially-adaptive-bit-rates): Johnston et al.. Book. Supplied bibliography entry.
- [Information Theory, Inference, and Learning Algorithms](https://www.synapsebooks.app/catalog/information-theory-inference-and-learning-algorithms): David J. C. MacKay. Work. Connections between information theory, inference, and machine learning.
- [Introduction to Data Compression](https://www.synapsebooks.app/catalog/introduction-to-data-compression): Khalid Sayood. Book. Supplied bibliography entry.
- [Introduction to Information Theory and Data Compression](https://www.synapsebooks.app/catalog/introduction-to-information-theory-and-data-compression): Darrel Hankerson, Greg Harris, Peter Johnson. Book. Supplied bibliography entry.
- [Lattices and Groups](https://www.synapsebooks.app/catalog/lattices-and-groups): Conway & Sloane, Sphere Packings. Book. Supplied bibliography entry.
- [Laws of Information Conservation and Aspects of Randomness](https://www.synapsebooks.app/catalog/laws-of-information-conservation-and-aspects-of-randomness): Leonid Levin. Book. Supplied bibliography entry.
- [List Decoding](https://www.synapsebooks.app/catalog/list-decoding): Madhu Sudan. Book. Supplied bibliography entry.
- [List Decoding of Polar Codes](https://www.synapsebooks.app/catalog/list-decoding-of-polar-codes): Ido Tal & Alexander Vardy. Book. Supplied bibliography entry.
- [Lossy Compression with Gaussian Diffusion](https://www.synapsebooks.app/catalog/lossy-compression-with-gaussian-diffusion): Ruizhe Yang, Stephan Mandt, Lucas Theis. Book. Supplied bibliography entry.
- [Lossy Image Compression with Compressive Autoencoders](https://www.synapsebooks.app/catalog/lossy-image-compression-with-compressive-autoencoders): Lucas Theis et al.. Book. Supplied bibliography entry.
- [Low-Density Parity-Check Codes](https://www.synapsebooks.app/catalog/low-density-parity-check-codes): Robert Gallager. Book. Supplied bibliography entry.
- [LT Codes](https://www.synapsebooks.app/catalog/lt-codes): Michael Luby. Book. Supplied bibliography entry.
- [LZMA Specification](https://www.synapsebooks.app/catalog/lzma-specification): Igor Pavlov. Book. Supplied bibliography entry.
- [Managing Gigabytes](https://www.synapsebooks.app/catalog/managing-gigabytes): Ian Witten, Alistair Moffat, Timothy Bell. Document. Supplied bibliography entry.
- [Modeling by Shortest Data Description](https://www.synapsebooks.app/catalog/modeling-by-shortest-data-description): Jorma Rissanen. Book. Supplied bibliography entry.
- [Modelling English Text](https://www.synapsebooks.app/catalog/modelling-english-text): William Teahan. Book. Supplied bibliography entry.
- [Modern Coding Theory](https://www.synapsebooks.app/catalog/modern-coding-theory): Tom Richardson & Rüdiger Urbanke. Book. Supplied bibliography entry.
- [Network Coding](https://www.synapsebooks.app/catalog/network-coding): Muriel Médard & Ralf Koetter. Book. Supplied bibliography entry.
- [Network Coding: An Instant Primer](https://www.synapsebooks.app/catalog/network-coding-an-instant-primer): Christina Fragouli, Jean-Yves Le Boudec, Jörg Widmer. Book. Supplied bibliography entry.
- [Network Information Flow](https://www.synapsebooks.app/catalog/network-information-flow): Rudolf Ahlswede et al.. Book. Supplied bibliography entry.
- [Neural Inter-Frame Compression for Video Coding](https://www.synapsebooks.app/catalog/neural-inter-frame-compression-for-video-coding): Abdelaziz Djelouah et al.. Book. Supplied bibliography entry.
- [Off-Line Dictionary-Based Compression](https://www.synapsebooks.app/catalog/off-line-dictionary-based-compression): N. Jesper Larsson & Alistair Moffat. Book. Supplied bibliography entry.
- [On the Computation of Rate-Distortion Functions](https://www.synapsebooks.app/catalog/on-the-computation-of-rate-distortion-functions): Imre Csiszár. Book. Supplied bibliography entry.
- [On the Relation Between Descriptions of Numbers and Descriptions of Sets](https://www.synapsebooks.app/catalog/on-the-relation-between-descriptions-of-numbers-and-descriptions-of-sets): Péter Gács. Book. Supplied bibliography entry.
- [Optical Flow and Mode Selection for Learning-Based Video Coding](https://www.synapsebooks.app/catalog/optical-flow-and-mode-selection-for-learning-based-video-coding): Théo Blard et al.. Book. Supplied bibliography entry.
- [Polynomial Codes over Certain Finite Fields](https://www.synapsebooks.app/catalog/polynomial-codes-over-certain-finite-fields): Irving Reed & Gustave Solomon. Book. Supplied bibliography entry.
- [PPM: One Step to Practicality](https://www.synapsebooks.app/catalog/ppm-one-step-to-practicality): Dmitry Shkarin. Book. Supplied bibliography entry.
- [Practical Loss-Resilient Codes](https://www.synapsebooks.app/catalog/practical-loss-resilient-codes): Michael Luby et al.. Book. Supplied bibliography entry.
- [Practical Network Coding](https://www.synapsebooks.app/catalog/practical-network-coding): Philip Chou, Yunnan Wu, Kamal Jain. Book. Supplied bibliography entry.
- [Raptor Codes](https://www.synapsebooks.app/catalog/raptor-codes): Amin Shokrollahi. Book. Supplied bibliography entry.
- [Rate Distortion Theory](https://www.synapsebooks.app/catalog/rate-distortion-theory): Toby Berger. Book. Supplied bibliography entry.
- [Rate-Distortion Optimization of Video Representations](https://www.synapsebooks.app/catalog/rate-distortion-optimization-of-video-representations): Habibian et al.. Book. Supplied bibliography entry.
- [Run-Length Encodings](https://www.synapsebooks.app/catalog/run-length-encodings): Solomon Golomb. Book. Supplied bibliography entry.
- [Statistical and Inductive Inference by Minimum Message Length](https://www.synapsebooks.app/catalog/statistical-and-inductive-inference-by-minimum-message-length): Chris Wallace. Book. Supplied bibliography entry.
- [Stochastic Complexity in Statistical Inquiry](https://www.synapsebooks.app/catalog/stochastic-complexity-in-statistical-inquiry): Jorma Rissanen. Book. Supplied bibliography entry.
- [Text Compression](https://www.synapsebooks.app/catalog/text-compression): Timothy Bell, John Cleary, Ian Witten. Book. Supplied bibliography entry.
- [The Benefits of Coding over Routing in a Randomized Setting](https://www.synapsebooks.app/catalog/the-benefits-of-coding-over-routing-in-a-randomized-setting): Tracey Ho et al.. Book. Supplied bibliography entry.
- [The Complexity of Finite Objects](https://www.synapsebooks.app/catalog/the-complexity-of-finite-objects): Alexander Zvonkin & Leonid Levin. Book. Supplied bibliography entry.
- [The Context Trees Method for Data Compression](https://www.synapsebooks.app/catalog/the-context-trees-method-for-data-compression): John Cleary, Ian Witten, Timothy Bell. Book. Supplied bibliography entry.
- [The Definition of Random Sequences](https://www.synapsebooks.app/catalog/the-definition-of-random-sequences): Per Martin-Löf. Book. Supplied bibliography entry.
- [The Minimum Description Length Principle](https://www.synapsebooks.app/catalog/the-minimum-description-length-principle): Peter Grünwald. Book. Supplied bibliography entry.
- [The Theory of Error-Correcting Codes](https://www.synapsebooks.app/catalog/the-theory-of-error-correcting-codes): Florence Jessie MacWilliams & Neil Sloane. Book. Supplied bibliography entry.
- [The Unknowable](https://www.synapsebooks.app/catalog/the-unknowable): Gregory Chaitin. Book. Supplied bibliography entry.
- [The Use of Asymmetric Numeral Systems as an Accurate Replacement for Huffman Coding](https://www.synapsebooks.app/catalog/the-use-of-asymmetric-numeral-systems-as-an-accurate-replacement-for-huffman-coding): Richard Duda, Khalid Tahboub, Neeraj Gadgil, Edward Delp. Book. Supplied bibliography entry.
- [Three Approaches to the Quantitative Definition of Information](https://www.synapsebooks.app/catalog/three-approaches-to-the-quantitative-definition-of-information): A. N. Kolmogorov. Paper. Paper listed in Volume III under Information, Cybernetics & Complex Systems.
- [Transmission of Information](https://www.synapsebooks.app/catalog/transmission-of-information-robert-fano): Robert Fano. Book. Supplied bibliography entry.
- [Universal Codeword Sets and Representations of the Integers](https://www.synapsebooks.app/catalog/universal-codeword-sets-and-representations-of-the-integers): Peter Elias. Book. Supplied bibliography entry.
- [Variable-Length Binary Encodings](https://www.synapsebooks.app/catalog/variable-length-binary-encodings): Edgar Gilbert & Edward Moore. Book. Supplied bibliography entry.
- [Variations on a Theme by Huffman](https://www.synapsebooks.app/catalog/variations-on-a-theme-by-huffman): Robert Gallager. Book. Supplied bibliography entry.
- [Variations on a Theme by Ziv and Lempel](https://www.synapsebooks.app/catalog/variations-on-a-theme-by-ziv-and-lempel): Victor Miller & Mark Wegman. Book. Supplied bibliography entry.
- [VCT](https://www.synapsebooks.app/catalog/vct): Fabian Mentzer et al.. Book. Supplied bibliography entry.
- [Zstandard Compression and the application/zstd Media Type (RFC 8878)](https://www.synapsebooks.app/catalog/zstandard-compression-and-the-application-zstd-media-type-rfc-8878): Yann Collet & Murray Kucherawy. Book. Supplied bibliography entry.

## Boundaries

Supplied list metadata. Selected editions and availability are not independently verified.
