Information

From AGIRI.org

Jump to: navigation, search

"Information" is an informal concept that has been formalized in a variety of different ways, each with strengths and weaknesses.
There are also various mathematical and conceptual relationships between the different formalizations.

Information and Entropy

In thermodynamics and communication theory, the information content of a communication channel or probability distribution may be defined as the negative of its Entropy.

Algorithmic Information

The Algorithmic Information of an entity is defined as, roughly, the length of the shortest self-delimiting program for producing that entity. (Note that this depends on an assumption regarding the Universal Turing Machine the program is running on; an assumption that is irrelevant as program length goes to infinity but potentially very relevant in practical cases.)

Information and Pattern

In Pattern Theory, information may be conceptualized as a synonym for Pattern in some entity, that is recognized by some Observer.

In this context, information is almost but not quite synonymous with Knowledge. The latter consists of Information that is stored within a Mind in a way that is usable by that mind for making judgments (i.e., it must be part of the mind's Memory).

Personal tools