One invaluable aspect of Shannon’s notion of entropy that has stuck with me from the very first read – which I think I stumbled upon as a teenager when doing background research for something else; (I know I read it in a public library that I don’t normally go to and it was before I first got online in 1989)…Cranford NJ – it came out of a vertical file and was stapled pages… sorry, visceral memory
..
anyway, what struck me was about the redundancy of information in English and how important that is in establishing EFFECTIVE communication under diverse circumstances.
It has enabled COMPRESSION to amazing degrees and also encryption to be possible (as that combined mathematical shuffling with a key with Shannon’s compression) – and so these little packages that you’re moving around are not just representative of bigger things; they _are_ the very bigger things themselves in highly reduced form.