This seems like a new definition of entropy unrelated to existing notions of entropy relevant to language. I'm not sure I buy "entropy = 1/abstractness"...
I subscribe to the notion of entropy in language increasing, but in opposition to the author I believe it is the result of reduced complexity, as words are redefined and reappropriated, meaning and nuance are lost, precision is lost, language starts to aggregate and density declines.
The author conflates "abstract words" with obscurity, implying reduced understanding, but the importance of this is knowability - even if the word is abstract the concept can be discerned (although may require a dictionary and thesaurus), when we move away from diverse, abstract, or obscure words separated from the closely related synonymous we make the conveyed and intended meaning of the sentence in which it is used much harder to know, and no external reference could enlighten us.
4 comments
[ 4.6 ms ] story [ 18.8 ms ] thread> f(word) -> R
What on earth is that? If f === "the meaning of", we'll all have different R's.
Prediction and Entropy of Printed English, Shannon 1951 https://www.princeton.edu/~wbialek/rome/refs/shannon_51.pdf
The author conflates "abstract words" with obscurity, implying reduced understanding, but the importance of this is knowability - even if the word is abstract the concept can be discerned (although may require a dictionary and thesaurus), when we move away from diverse, abstract, or obscure words separated from the closely related synonymous we make the conveyed and intended meaning of the sentence in which it is used much harder to know, and no external reference could enlighten us.