engleski

On some inequalities for the entropy and mutual information of random vectors

We investigate the mutual information associated with a finite sequence of characters being transmitted and received after passage through a noisy channel. In particular this information is known to be greater than the sum of the corresponding quantities for the component characters in the case when the input characters are independent and less in the case when the channel is memoryless. We provide estimates of the difference for both these important cases.

Inequalities; entropy; information; random vectors

nije evidentirano