Context: Shannon and my associations
First category Grouping) Learning : Effectiveness : Redundancy : Low Entropy : Sparse : Many Patterns To Find : More relaxed : Large
b) Production : Efficiency : Surprise : High Entropy : Compressed : Looks like noise : Tense : Small
My gut says Database might be First category Grouping) and Algorithm might be b) but I’m not 100% if they’re opposite. My intuition says they are but I need confirmation which I’ll look for later as it’s unlikely to be an original thought overall, just original to me.
First Category Grouping) both asynchronous and synchronous
b) synchronous. Why? Precision machinery requires precise timing. Particular amount of turns or a particular clock time or a particular position
First category Grouping) No or simple decryption key / rulebook / meta / external knowledge requirements
b) Much decryption as it’s much encrypted. Many rules/axioms to follow. A lot of metadata. Much external knowledge requirements.
First category grouping) Meaning not pre-determined but with much flexibility in pattern finding and interpretation. Room.
b) Meaning pre-determined. Single purpose parts so few copies of information.
Notion of “dynamic frustration” can be useful here.
Oh lol i wound my way back to linguistics from reasoning through Shannon. I thought “oh, words are not the basic unit because what about idioms?” looked up idioms, found lexicon, then lexis.
In linguistics, a lexis or lexicon is the complete set of all possible words in a language (vocabulary). In this sense, child, children, child’s and children’s are four different words in the English lexicon
In short, the lexicon is:
Formulaic: it relies on partially fixed expressions and highly probable word combinations
Idiomatic: it follows conventions and patterns for usage
Metaphoric: concepts such as time and money, business and sex, systems and water, all share a large portion of the same vocabulary
Grammatical: it uses rules based on sampling of the Lexicon
Register-specific: it uses the same word differently and/or less frequently in different contexts
Oh lol it’s tying a bunch of stuff together for me.
Ah Lexis entry is satisfying: On here I see:
MAK Halliday. [I found Aug 21 2016]
“He claims that speech is grammatically complex while writing is lexically dense. In other words, a sentence such as “a cousin of mine, the one about whom I was talking the other day—the one who lives in Houston, not the one in Dallas—called me up yesterday to tell me the very same story about Mary, who…” is most likely to be found in conversation, not as a newspaper headline. “Prime Minister vows conciliation”, on the other hand, would be a typical news headline. One is more communicative (spoken), the other is more a recording tool (written)”
Systemic Functional Linguistics (Halliday’s baby) gets early mention.
George Lakoff [I was writing about him on FB in 2014 but I’m sure it’s sooner]
“Metaphor as an organizational principle for lexis”
Concordance, which is something I’ve been playing with on an off for a long time. Love watching the same word line up in a long corpus and all the different homes it finds itself in.
and Shannon is hiding in
“Formulaic: it relies on partially fixed expressions and highly probable word combinations”
even thought not mentioned. Showing the redundancy in English the way he did was one of the really amazing features of his 1948 writing that got me so excited way back as a teenager looking into information theory. I still remember hearing in my head the language getting more and more scrambled over the WW2 radios and being able to understand them because of the redundancy in language and how blown away I was and am at that feature in language.