Education and Didactics

   

Interpretation of Shannon Entropies with Various Bases by Means of Multinary Searching Games

Authors: Hsuan-Hao Chao, Chang Hsu, Long Hsu, Sien Chi

Ben-Naim used twenty question games to illustrate Shannon entropy with base 2 as a measure of the amount of information in terms of the minimum average number of binary questions. We found that Shannon entropy with base 2 equal to the minimum average number of binary questions is only valid under a special condition. The special condition is referred to as the equiprobability condition, which requires that the outcomes of every question have equal probability, thus restricting the probability distribution. This requirement is proven for a ternary game and a proposed multinary game as well. The proposed multinary game finds a coin hidden in one of several boxes by using a multiple pan balance. We have shown that the minimum average number of weighing measurements by using the multiple pan balance can be directly obtained by using Shannon entropy with base b under the equiprobability condition. Therefore, Shannon entropy with base b can be interpreted as the minimum average number of weighing measurements by using the multiple pan balance when the multiple outcomes have equal probability every time.

Comments: 8 Pages.

Download: PDF

Submission history

[v1] 2020-01-02 09:59:43

Unique-IP document downloads: 4 times

Vixra.org is a pre-print repository rather than a journal. Articles hosted may not yet have been verified by peer-review and should be treated as preliminary. In particular, anything that appears to include financial or legal advice or proposed medical treatments should be treated with due caution. Vixra.org will not be responsible for any consequences of actions that result from any form of use of any documents on this website.

Add your own feedback and questions here:
You are equally welcome to be positive or negative about any paper but please be polite. If you are being critical you must mention at least one specific error, otherwise your comment will be deleted as unhelpful.

comments powered by Disqus