After a historical reconstruction of the main
Boltzmann’s ideas on mechanical statistics, a discrete version of Boltzmann’s
H-theorem is proved, by using basic concepts of information theory. Namely, H-theorem follows from the central limit theorem, acting inside a closed physical
system, and from the maximum entropy law for normal probability distributions,
which is a consequence of Kullback-Leibler entropic divergence positivity.
Finally, the relevance of discreteness and probability, for a deep
comprehension of the relationship between physical and informational entropy,
is analyzed and discussed in the light of new perspectives emerging in
computational genomics.
Shannon, C.E. (1948) A Mathematical Theory of Communication. The Bell System Technical Journal, 27, 623-656.
https://doi.org/10.1002/j.1538-7305.1948.tb00917.x
Wheeler, J.A. (1990) Information, Physics, Quantum: The Search for Links. In: Zurek, W.H., Ed., Complexity, Entropy, and the Physics of Information, Addison-Wesley, Redwood City, 354-368.
Brush, S.G. and Hall, N.S. (Eds.) (2003) The Kinetic Theory of Gases. An Anthology of Classical Papers with Historical Commentary. Imperial College Press, London.
Carnot, S. (1890) Reflections on the Motive Power of Heat (English translation from French edition of 1824, with introduction by Lord Kelvin). Wiley & Sons, New York.
Feynman, R.P. (1963) The Feynman Lectures on Physics. Vol. I, Part 2. Addison-Wesley Publishing Company, Inc., California Institute of Technology, Boston.
Boltzmann, L. (1872) Weitere Studien uber das Warmegleichgewicht unter Gasmolekulen, Sitzungsber. Kais. Akad. Wiss. Wien Math. Naturwiss. Classe, 66, 275-370.
Boltzmann, L. (1877) über die Beziehung zwischen dem Zweiten Hauptsatze der mechanischen Warmetheorie und der Wahrscheinlichkeitsrechnung resp. den Satzen über das Warmegleichgewicht, Sitzungsber. Kais. Akad. Wiss. Wien Math. Naturwiss. Classe, 76, 373-435.
Sharp, K. and Matschinsky, F. (2015) Translation of Ludwig Boltzmann’s Paper “On the Relationship between the Second Fundamental Theorem of the Mechanical Theory of Heat and Probability Calculations Regarding the Conditions for Thermal Equilibrium’’. Entropy, 17, 1971-2009.
https://doi.org/10.3390/e17041971
Planck, M. (1972) Planck’s Original Papers in Quantum Physics. Annotated by H. Kangro, translated by Haar, ter D.; Brush, S. G. Taylor & Francis, London.
Bonnici, V. and Manca, V. (2016) Informational Laws of Genome Structures. Nature Scientific Report, 6, 28840.
http://www.nature.com/articles/srep28840
https://doi.org/10.1038/srep28840
Holzinger, A., Hortenhuber, M., Mayer, C., Bachler, M., Wassertheurer, S., Pinho, A.J. and Koslicki, D. (2014) On Entropy-Based Data Mining. In: Holzinger, A. and Jurisica, I., Eds., Knowledge Discovery and Data Mining, Springer, Berlin, 209-226.
https://doi.org/10.1007/978-3-662-43968-5_12
Manca, V. (2016) Infogenomics: Genomes as Information Sources. In: Arabnia, H. and Tran, Q., Eds., Emerging Trends in Applications and Infrastructures for Computational Biology, Elsevier, Morgan, 317-324.
https://doi.org/10.1016/b978-0-12-804203-8.00021-3
Abhishek, S., Asok, R. and Shalabh, G. (2009) An Information-Theoretic Measure for Anomaly Detection in Complex Dynamical System. Mechanical Systems and Signal Processing, 23, 358-371.
https://doi.org/10.1016/j.ymssp.2008.04.007