omg i just found Shannon’s “A Mathematical Theory of Communication” (1948). I last read it 25+ years ago as a teenager and his talk on redundancy in English blew me away then AND it’s still blowing me away again.
Thank you Stu Mack and Nick Stanley. You got my brain jump-started and now I’m going to re-read with a fresh pair of eyes one of my all time favorite papers.
I don’t know why it took me so long to go back to it. It shows how Shannon defined the very language used in Information Theory which is why it’s so familiar and easy to read now.
ERROR CORRECTION bits. It was in the paper all along.