Redundancy (information theory)

Evaluación | Biopsicología | Comparativo | Cognitivo | Del desarrollo | Idioma | Diferencias individuales | Personalidad | Filosofía | Social | Métodos | Estadística | Clínico | Educativo | Industrial | Artículos profesionales | Psicología mundial | Estadística: Método científico · Métodos de búsqueda · Diseño experimental · cursos de pregrado de estadistica · Pruebas estadísticas · Teoría de juego · Decision theory Redundancy in information theory is the number of bits used to transmit a message minus the number of bits of actual information in the message. Data compression is a way to eliminate unwanted redundancy, while checksums are a way of adding desired redundancy for purposes of error correction when communicating over a noisy channel of limited capacity. Quantitative definition Recall that the rate of a source of information is (in the most general case) the expected, or average, conditional entropy per message (es decir. per unit time) given all the previous messages generated. It is common in information theory to speak of the "Velocidad" o "entropy" of a language. This is appropriate, por ejemplo, when the source of information is English prose. The rate of a memoryless source is simply , since by definition there is no interdependence of the successive messages of a memoryless source. The absolute rate of a language or source is simply the logarithm of the cardinality of the message space, or alphabet. (This formula is sometimes called the Hartley function.) This is the maximum possible rate of information that can be transmitted with that alphabet. (The logarithm should be taken to a base appropriate for the unit of measurement in use.) The absolute rate is equal to the rate if and only if the source is memoryless and has a uniform distribution. The absolute redundancy can then be defined as the difference between the rate and the absolute rate. The quantity is called the relative redundancy and gives the maximum possible data compression ratio, when expressed as the percentage by which a file size can be decreased. (When expressed as a ratio of original file size to compressed file size, the quantity gives the maximum compression ratio that can be achieved.) Complementary to the concept of relative redundancy is efficiency, defined as A memoryless source with a uniform distribution has zero redundancy (and thus 100% efficiency), and cannot be compressed. See also Source coding Source coding theorem Data compression References Fazlollah M. Reza. An Introduction to Information Theory. Nueva York: McGraw-Hill 1961. Nueva York: Dover 1994. ISBN 0486682102 B. Schneier, Applied Cryptography: Protocols, Algorithms, and Source Code in C. Nueva York: Juan Wiley & Hijos, Inc. 1996. ISBN 0471117090 {{enWP|Redundancy (information theory)}

Si quieres conocer otros artículos parecidos a Redundancy (information theory) puedes visitar la categoría Information theory.

Deja una respuesta

Tu dirección de correo electrónico no será publicada. Los campos obligatorios están marcados con *


we use own and third party cookies to improve user experience More information