Quantitative Entropy Study of Language Complexity
Table 4: Specific entropy of the Sample texts based on Chinese words, where Ns is the number of words in the Sample text, σw is the entropy of the text, and σw/10k is the entropy of the text normalized to 10000 word length.
['|| Sample', '[ITALIC] Ns', '[ITALIC] σw', '[ITALIC] σw/10 [ITALIC] k']
Then we add up the entropy contribution of all observed sentences of all lengths in the Sample texts. This provides the total specific entropy σw=(508.5, 229.4, 8.399, 7.106) ⋅10−3, (8) for Sample texts I−IV respectively.