The view of Shannon-Wiener entropy according to Norman Dolloff (1975), who sees information entropy as an "open sesame" to the sciences of man, thereby connecting information measures of things such as DNA to thermodynamics. [7] |

Overview

In 1948, American electrical engineer Claude Shannon proposed the following formula, modeled on

where

This troublesome terminology, i.e. equating entropy with information, was borrowed from statistical thermodynamics, through the suggestion of American chemical engineer John von Neumann and introduced in 1948 by Shannon, but without explicit conditional warnings as to its realm of applicability. [2] Because of its mathematical simplicity, namely that it refers, supposedly, to the thermodynamic concept of "entropy", but is cut off atomic and molecular reality (difficulties), it soon, within a period of eight years, according to Shannon, "ballooned to an importance beyond its actual accomplishments (a technical tool for communication engineers)" into fields such as the thermodynamic modeling of life, evolution, cybernetics, biology, psychology, linguistics, fundamental physics, economics, the theory of organization, Maxwell's demon, and many others. [3]

For thermodynamicists, the 1948 use of the term "entropy" to model information in signals has been, in a general sense, an irritation. [5] The model employed by Shannon suggests to many individuals that anything which fits into the form of a logarithm has something to do with the second law of thermodynamics, which is not the case.

There are some, for instance, who believe that “information” will soon replace the Clausius version of “entropy”. Israeli physical chemist Arieh Ben-Naim, in his 2008 book

In any event, Ben-Naim advocates replacing entropy by information, a term that has become widely used in many branches of science. [4] This type of logic, however, is highly illogical: information is not a fundamental quantity, whereas "energy", or its derivatives, "heat", "temperature", or "work", are. The idea of reducing thermodynamics down to information, to note, is similar to Greek mathematician Constantin Carathéodory’s 1909 efforts, in his

References

1. Shannon, C.E. (1948). "A Mathematical Theory of Communication",

2. Tolman, R.C. (1938

3. Shannon, C.E. (1956). "The Bandwagon" (PDF),

4. Ben-Naim, Arieh. (2008).

5. Muller, Ingo. (2007).

6. Georgiadou, Maria. (2004).

7. Dolloff, Norman H. (1975).