Diving into Information Theory
I have begun to delve into the mysteries of information theory. I plan to post the results here. I cannot predict where it will lead, but it will be great fun. For now I plan the following:
1) The nature of information.
2) Channel capacity.
3) Gaussian channels.
4) Fisher information.
5) The thermodynamics of information.
6) The statistical mechanics of information.
7) Ergodic sources.
8) Entropy
9) Detecting information.
10) Measure of information.
11) Encoding.
12) Noiseless coding.
13) Discrete channels.
14) Error-correcting codes.
15) Channels with memory.
16) Continuous channels.
It is possible that I will get to quantum information and black holes.
Great topic to get into. I think the list above is on the right track. I have been into info theory for years given one of my first interests in physics was entropy. Once you get your grounding, you probably want to look at E.T. Jaynes work, particularly his papers Information Theory and Statistical Mechanics I & II. Great work but also a segway into the contentious, yet sometimes useful, ideas of the MaxEnt (maximum entropy) crowd. Happy Research!
ReplyDeleteI have also been interested in this for many years, but until now I have never done anything other than read. I plan to develop some Mathematica-based simulation software for information theory.
ReplyDelete