In this installment I demonstrate how to determine some of the quantities we have been looking into using Mathematica 8. You can find it at this website:

http://www.madscitech.org/csg/it.html

under Information Theory V.

## Thursday, June 28, 2012

## Sunday, June 17, 2012

### The Nature of Information IV

In this post I examine what coding is and introduce Shannon's First Coding Theorem and the Shannon-McMillan Theorem. See Information Theory IV.

## Wednesday, June 13, 2012

### The Nature of information III

In this posting I explore the probability of finding strings and establish the principle that the chace of finding a given string is independent from the elements of the string. This result is called the

*Asymptotic Equipartition Property*. For details go to the The Nature of Information III## Friday, June 1, 2012

### New place for formatted information theory.

Due to the difficulty in placing the mathematical symbols into the blog, I will encapsulate the post and provide a link to the formatted version.

In general these will be located at: http://www.madscitech.org/csg/it.html.

In general these will be located at: http://www.madscitech.org/csg/it.html.

Subscribe to:
Posts (Atom)