Contents  > Science  > Math  > Applications  > Information Theory

See also:

• Computers: Computer Science: Theoretical  (384)
• Science: Math: Applications: Complex Systems  (89)

Algorithmic Information Theory Open problems and links to software. http://www.cs.auckland.ac.nz/CDMTCS/docs/ait.html

Basics of Information Theory A brief introduction to information theory by David S. Touretzky of Carnegie Mellon University. http://www.cs.cmu.edu/~dst/Tutorials/Info-Theory/

The Classic Definition of Information From the Web Dictionary of Cybernetics and Systems. http://pespmc1.vub.ac.be/ASC/INFORMATION.html

A Discipline Independent Definition of Information An article about some sides of Information Theory written by Robert M. Losee. Also there is link to pdf-version of article. http://www.ils.unc.edu/~losee/b5/book5.html

Entropy on the World Wide Web A collection of links to on-line expository articles on entropy and theory of information, maintained by Roland Gunesch (University of Hamburg). http://www.math.uni-hamburg.de/home/gunesch/entropy.html

Information Theory Wikipedia article on this branch of applied mathematics and electrical engineering involving the quantification of information. http://en.wikipedia.org/wiki/Information_theory

Information Theory and Music An article on this subject. Definition of information theory, probability and Markov chains. http://www.music-cog.ohio-state.edu/Music829D/Notes/Infotheory.html

Information Theory Resources Small collection of links about Information Theory and Claude Shannon. http://www-lmmb.ncifcrf.gov/~toms/itresources.html

Introduction To Algorithmic Information Theory An introduction to the synthesis of computation and information theory by Nick Szabo. http://szabo.best.vwh.net/kolmogorov.html

Linear Complexity: A Literature Survey The linear complexity (LC) of a sequence is the size in bits of the shortest linear feedback shift register (LFSR) which can produce that sequence. The measure speaks to the difficulty of generating, and perhaps analyzing, a particular sequence. http://www.ciphersbyritter.com/RES/LINCOMPL.HTM

Organs of Computation A Talk With Steven Pinker. http://www.edge.org/documents/archive/edge3.html

Remembering Claude Shannon Describes the development of information theory and Claude Shannon's contribution to the field. http://www.corp.att.com/attlabs/reputation/timeline/16shannon.html

Self-Organizing Systems (SOS) FAQ Includes a very extensive catalog of links on SOS. http://www.calresco.org/sos/sosfaq.htm

A Short Course in Information Theory Eight lectures on information theory by David MacKay. http://www.inference.phy.cam.ac.uk/mackay/info-theory/course.html