home Biological until 1854 Formalization 1854-1937 Revolutions 1937-1951 Electronic Age
Location: http://members.tripod.de/s_ulf/csh/formal.html & http://www.cs.mun.ca/~ulf/csh/formal.html. By Ulf Schünemann since 251198. Please mail any comments.

Comprehensive History of Information and Computing
1854-1937: The Time of Formalization

During this time five ideas were established/persued, which reinforced and/or competed-with one another:
  1. Algebraization[<>]: Draw up to inventory of operations in a field of study, investigate their relation (equalities), find primitive operations.
    CONTRA: Cantor's 1874 discovery of overcountability of R [>] (and examples of transcendentality of certain numbers like 1882 [>]) meant that there are mathematical object which cannot be "reached" by applying operations = which cannot be constructed algebraically [-> which cannot be represented uniquely by (finite compositions of) symbols]
    -> constructive mathematics[>]
  2. Formalization:
    1. Knowledge representation (axiomatization): Knowledge/statements can be encoded symbolically without ambiguity
      -> Axiomatization of various branches of mathematics, like geometry, arithmetic, analysis, and set theory.
      <- This was persued by the mathematical school of logic, including Dedekind, Peano, Hilbert, Pasch, Veblen, Huntington, Heyting, and Zermelo [x].
      CONTRA: intuitionism around 1900: «it is impossible to define the properties of mathematical objects simply by establishing a number of axioms» [>]
    2. Symbol manipulation (calculi)[<>]: Symbolism is the idea that mathematics and logics can be reduced to symbol manipulation [Log], defined as a "calculus" of manipulation rules (in particular sound logical derivations) which depend on the symbols' form, not meaning (hence formal logic/mathematics).
      -> Development of logical calculi -> (later also other calculi, like lambda calculus)
      <- Primary aim of the algebraic school of logic, starting with Boole and including Peirce[>], Jevons[>], Schröder, Venn[>], Löwenheim[>], etal.). They investigate similarities between reasoning and mathematical operations in an abstract algebra way. Quantifiers were (sometimes) taken to be (infinitarily) extended conjunctions and disjunctions. [x].
      <- Also investigated by the logicist school[>].
      <- whereas logic focuses on sound derivation rules, in AI also other reasoning rules will be explored: eg., probabilistic reasoning, agents with economic rationality, analogies, "heuristics" ... [Randall Davis, Howard E Shrobe, Peter Szolovits: What Is a Knowledge Representation?; AI Magazine 14(1); 1993]
    -> meta-mathematics[>] from 1900 on studied axiomatizations and calculi themselves.
    CONTRA: Psychology developed completely different model of reasoning, as a particular variety of human behavior, an empirical phenomenon from the natural world. (once it was emancipated from logic-focused philosophy and from body-focused medicine). And neurology has a completely different perspective to thinking as well. [Randall Davis, Howard E Shrobe, Peter Szolovits: What Is a Knowledge Representation?; AI Magazine 14(1); 1993]
    -> in AI, this will lead to alternatives to symbolic AI, in particular, frame-based systems, and neural networks.
  3. Algorithmization: An algorithm/strategy can be defined which specifies when to apply which rule so that a successful outcome of the symbol manipulation [in logic: the proof = derivation of a theorem] can be guaranteed (unless no such successful outcome exist).
    CONTRA: logic - tries to be general (declarative), not recommending any particular use of a rule. «Methods of formal logic are elementary and certain ... However, logic does not teach us how to build a proof. It is intuition that helps mathematicians find the correct way of to assemble basic inferences into a useful proof» [Poincaré]
  4. Automatization: The transition to computing, expressed by Turing 1936/37[>], is that such algorithmisized symbol manipulation, and hence reasoning/logic, can be carried out by a machine.

2nd Age of Logic[<>]:   Transition to Modern Logic   (1854-1930s)
Step 1: Algebraic Logic - Logic as Mathematics: Boole, DeMorgan
Step 2: Symbolic Logic - Logic as Symbol Manipulation: Jevons, Frege
  • Algebra, 1860[<>]: DeMorgan's [<] In 1860, he writes on the algebra (calculus?) of logic and binary relations (no equational calculus). DeMorgan appears to see relation composition as a form of conjunction, writes relation composition (as ab?) like logical conjunction (AND). He speaks of "composition" for conjunction («animal» and «reason» are "compounded" in «man» - an impossible "component" puts the "compound" out of existence) and of "aggregation" for disjunction («man» and «brute» are "aggregated" in «animal» - an impossible "aggregant" does not put the "aggregate" out of existence).
    - Notation: He writes "))" for <.
    - Research in relations was continued by Peirce 1870[>], Schröder 1895[>], Russell 1900[>], Ward and Dilworth 1939[>], Tarski 1941, Birkhoff 1948 [CBR].
    - «DeMorgan recognized the purely symbolic nature of algebra, and was aware of the possibility of algebras different from ordinary algebra» [source?]
1879, the Begriffsschrift by Gottlob Frege's [>] (Germany), the ``greatest logician since Aristotle'' [x], is the first to fully develop the main thesis of logicism, that arithmetic and analysis are reducible to, or even parts of, logic.
  1. Logic [<>]: The logicist school of logic [algebraists|mathematists] includes, besides Frege esp. Russell, and perhaps the early Wittgenstein. «Logicists such as Bertrand Russell and Gottlob Frege believed that mathematics is basically a branch of symbolic logic, because they supposed that mathematical terminology can be defined using only the terminology of logic and because, after this translation of terms, any mathematical theorem can be shown to be a restatement of a theorem of logic.» [Poincaré]
    This is in opposition to intuitionism: «mathematics has priority over logic». Poincaré: Peano's axiom of complete induction is not provable by means of general logical laws - hence logicism is refuted [Poincaré]
    «The traditional logicist programme consists of systematic translations of statements of mathematics into a language of pure logic. For Frege, statements about natural numbers are statements about the extensions of certain concepts. The number three, for example, is the extension of the concept that applies to all and only those concepts that apply to exactly three objects. Frege was not out to eliminate mathematical ontology, since he held that logic itself has an ontology, containing concepts and their extensions» [x].
    To logicists, logic is independent of subject-matter, not the abstraction from the reasoning in particular disciplines and contexts. The aim was to codify the underlying logic of all rational, scientific discourse into a single system [x].
    «Because the languages are completely general, there is no interesting perspective 'outside' the system from which to study it. The orientation of the logicists has been called 'logic as language', and that of the mathematicians and algebraists 'logic as calculus'.» [x].
    «Quantifiers are understood as they are in current logic textbooks, not as extended conjunctions and disjunctions. Unlike the algebraists, Frege did not envision various domains of discourse, each of which can serve as an interpretation of the language. Rather, each (first-order) variable is to range over all objects whatsoever» [x].
  2. Logic [<>]: The logic used for explaing mathemantics is not the classical logic of philosphers, it is a new ``mathematical logic''. In his Begriffsschrift Frege developed a rich formal language with full mathematical rigour for higher order logic [x].
    Frege uses mathematical terminology like "function" and "argument", "truth value", etc., instead of logical terminology like "subject" and "predicate", "syllogism", etc. [TEP].
    «The strong historical infuence of mathematics on logic during the 19th and 20th centuries, while providing logic with high standards of rigor, has had the limiting effect of developing logic in a timless, Platonic, direction that is not well suited for the dynamic nature of computation» [José Messeguer: A Logical Theory of Concurrent Objects; 101-115, OOPSLA/ECOOP'90] For a more technical view see rewriting logic.
  3. Symbolism[<] «Frege's work started contemporary formal logic.» «Prior to Frege, formal logic had not been successful beyond the level of sentential logic: it could represent the structure of sentences composed of other sentences using such words as "and", "or", and "no".» «Aristotelian logic was capable of dealing with objects and not just sentences, but it was known to have a number of fallacies, and no way had been found to remove these systematically.»
    «Frege's insight was that by discovering "quantifiers" in sentences, we can reduce many more of them into structures of term-and-predicate which we can operate on logically without running into the fallacies of Aristotelian logic. Frege expanded logic to include words such as "all", "some", and "none".» [wiki]
    [>]: Frege does predicate logic as a symbol manipulation calculus [Log] (he uses «derivation from the syntactic form» [TEP]).
  4. Notat. [<]: The two-dimensional notation of the Begriffsschrift, a ``universal language of ratio'' [TEP], remained unsuccessful.
  5. Axiomatization [<>]: In order to reduce mathematics to logic, mathematics has to axiomatized. Frege «made great strides in casting number theory within the system of the Begriffsschrift». He continued the work in 1884, 1893 and 1902, when Russell pointed out Russell's paradox in Frege's complete theory of extensions; circumvented in Russell's types [>].

1893-1937: Age of Commercial Electro-Mechanical Processors

1890-93: Herman Hollerith (MIT and US Census Bureau) was hired by the U.S. Census Bureau in 1880 as a statistician after graduating from Columbia School of Mines in New York in 1879. The 1880 census took 7 years to complete.
Processor: After failing with data encoded on (easy ripping) paper strips, he considered punched cards. At MIT: Processor for tabulating data on punch cards [monotype/Differential Analyzer]. The holes close circuits triggering mechanical counters and sorter bins.
Won the competition for the delivery of data processing equipment for the 1890 US Census with his Punch Card Tabulating Machine, mechanical processors (programmable with wires and plugs) to read, count, tally and sort data on punch cards. saved $5 million and 7 1/2 years' time. [No multiplication? -- 1931 ``first'' IBM multiplying machine]. C.f. National Geographic on the 1900 Census.
[from here]: «It is important to note that the typical card processing applications from the 1890's to the 1950's did not require the use of computers! A deck of cards from a retail application, for example, could be sorted by the category field on a card sorter, and then each category could be run through a tabulating machine to sum the price fields of all cards in that category or similar accounting functions.»
A description of machines for sorting and for comparing cards (by their information content).

Cards: A character of data was stored by punching holes into some of 12 rows with a column on a card [from here]: «The original code used for punched card data recording had only 240 distinct punch positions per card [implying 20 columns],
but in the early 1900's, a new standard card format was introduced with 45 columns of round holes per card and 12 punch positions in each column (540 punch positions).
» (12 rows × 45 columns)
«In 1928, Hollerith's company, now renamed IBM, introduced the rectangular hole 80 column format, almost doubling the amount of data that could be recorded on a card». This one IBM could (later) patent and make most money. («Babbage's proposed use of cards played a crucial role in later years, providing a precident that prevented Hollerith's company from claiming patent rights on the very idea of storing data on punched cards»). From this card derives the 80 columns text screen.

Encod.:

  1. 3 zones: 1 optional punch in first 2 rows (1:1 selection of 3 ``zone'') × 1 optional punch in remaining 10 rows (1:1 selection) = 33 combinations (10 digits + 22 letters + space)
  2. 4 zones: optional punch in first 3 rows (4 ``zones'') × optional punch in remaining 9 rows = 40 combinations (all digits and letters + `*' `-' `.' space)
  3. Full BCD allows additional combinations: (#1) 1st or 2nd row together with 3rd row if rest is empty, and (#2) additional punch in 11th row if no punch in 4th or 12th row => 66 combinations.
  4. EBCD disallows BCD extension #1 => 64 combinations (8-bit tape codes based on EBCD)
  5. binary zones allow any combination of punches in first 3 rows (8 zones), and BCD extension #2 => 256 combinations.

Commerce, 1896: Founded company to sell his machines to companies for processing buisness data (1914, merged with two other companies; 1924, renamed to IBM).

  1. Axiomatization, 1899[<>]: David Hilbert[>] (Germany) formally axiomatizes geometry
  2. Logic [<>]: The reliance on rigorous axiomatization and deduction (by logicists as well as mathematists) raised interest in formal languages and deductive systems. The systems themselves became objects of mathematical study (based on the mathematical school? - cf. [x]). Such efforts became known as metamathematics [x].
    «Hilbert and his followers held that the only meaningful, or 'contentful', parts of mathematics consist of finitary assertions about finitary objects, like natural numbers. This includes particular statements like '234 + 123 = 357' and generalizations like 'a + b = b + a', made with free variables. It does not include statements, like 'for every n there is a p greater than n, such that p and p + 2 are both prime', that contain bound variables ranging over an infinite domain. The infinitary, or 'ideal', parts of mathematics, including analysis and set theory, have value only in the role of facilitating the production of finitary, contentful statements. In each case, we need to be assured that the use of ideal mathematics does not yield anything incorrect about the finitary part. (Instrumentalism.) The Hilbert programme called for each branch of mathematics to be formalized and for the formalisms to be studied metamathematically. Noting that the subject-matter of metamathematics - sequences of characters - is finitary, Hilbert declared that metamathematics be conducted with only finitary means. Then, once the consistency of a formal deductive system is established, the system can confidently be used to produce finitary results. (Consistency proofs.) » [x].
    «In some cases, such as Hilbert and his followers, [metamathematics] was part of a formalist philosophical agenda, sometimes called the Hilbert programme. (Formalism.) Others, like Heyting, produced axiomatic versions of the logic of intuitionism and intuitionistic mathematics, in order to contrast and highlight their revisionist programmes (see Brouwer).
    A variation on the mathematical theme took place in Poland under Lukasiewicz and others. Logic itself became the branch of mathematics to be brought within axiomatic methodology. Systems of propositional logic, modal logic, tense logic, Boolean algebra, and mereology were designed and analysed.
    A crucial development occurred when attention was focused on the languages and the axiomatizations themselves as objects for direct mathematical study. Drawing on the advent of non-Euclidean geometry, mathematicians in this school considered alternative interpretations of their languages and, at the same time, began to consider metalogical questions about their systems, including issues of independence, consistency, categoricity, and completeness. Both the Polish school and those pursuing the Hilbert programme developed an extensive programme for such 'metamathematical' investigation. (Metalanguage; metalogic.) Eventually, notions about syntax and proof, such as consistency and derivability, were carefully distinguished from semantic, or model-theoretic counterparts, such as satisfiability and logical consequence.» [x].
    «The ensuing metamathematical research culminated with Gödel's incompleteness theorems [>], which dealt a serious blow to the Hilbert programme» [x].
3rd Age of Linguistics[<]: Modern Linguistics (1906-present)
  • Linguistics, 1906-11[<>]: Ferdinand de Saussure's (Univ of Geneva) course of general linguistics starts "modern linguistics" (a structuralist approach): priority of spoken language, language is a convention, historic evolution is of little interest, linguistics is descriptive not normative, ... He distinguishes langue (abstract language system) from parole (actual language products) [EML], and syntagmatic structures (words in context) from paradigmatic classes (words in sets like the parts of speech) [x].
  • Meaning[<>]: A sign has a two sides: the signifier (form/material) and the signified (content/mental). Their relationship is a cultural convention [Sem].
    • Philosophy, 1907: L E J Brouwer's intuitionism, a development from constructive mathematics. «Intuitionism stresses that mathematics has priority over logic, the objects of mathematics are constructed and operated upon in the mind by the mathematician, and it is impossible to define the properties of mathematical objects simply by establishing a number of axioms» [ref].
      Also Poincaré (France 1854-1912): «Poincaré was absolutely correct, however, in his criticism of those like Russell who wished to axiomatise mathematics were doomed to failure. The principle of mathematical induction, claimed Poincaré, cannot be logically deduced. He also claimed that arithmetic could never be proved consistent if one defined arithmetic by a system of axioms as Hilbert had done. These claims of Poincaré were eventually shown to be correct».
    • Axiomatization, 1908 [<>]: Zermelo's axiomatization of set theory. The theory now known as Zermelo-Fraenkel set theory is the result of some modifications and clarifications, due to Skolem, Fraenkel, and von Neumann, among others [x].
    • Telecom, 1910: Krum's teleprinter (based on Pearne's idea): typewriter-style keyboard to enter outgoing messages, paper roll for printing incoming messages.
    • Theory, 1910: Axel Thue's (Norway) paper on the word problem for finitely presented semigroups.
    • Encod., 1911: The Chinese telegraphic code book (CTC) assigns 4 digit code numbers for 9800 Chinese characters. [see here for CTC and here for other code books]
    • Meaning, 1913<>]: Selz recognized the importance of representing the relation between entities (as labels on the links in associative networks) - «The decisive step in converting an associative network into a potential semantic machine».
    • Calculator, 1914: U Knorr's (Germany) Fahrdiagraph [Millionaire/Mallock], is an integrator for train time table calculations (based on train mass and power, and air and rail resistance) with a mechanical torsion amplifier.
    • Logic, 1915 [<>]: «Löwenheim carefully delineated what would later be recognized as the first-order part of a logical system, and showed that if a first-order formula is satisfiable at all, then it is satisfiable in a countable (or finite) domain. Skolem went on to generalize that result ...» [x].
    • Encod. 1918: Gilbert Vernam (US) develops encryptions scheme. Implemented in the Lorenz SZ42 cipher machine which enciphered electrical teleprinter signals in the international 5-bit Baudot teleprinter code.
    • Technology, 1919: Eccles' and Jordan's paper on flip-flop circuits.
    • Society, 1920: Karel Capek (Czech author) introduces the term "robot" for human-looking machines. Yhey revolt against mankind in his novel.
    • 1920 [<>]: Emil Post[>] (logician, Poland/USA), in his PhD thesis, proved completeness and the consistency of the propositional calculus in Principia Mathematica by introducing the truth table method (for "true" and "false", but also for an arbitrary finite number of truth values).
      Notation: A new idea was to give a framework for inference/deduction systems based on a finite process of symbol manipulation specified by productions.
      «It would be fair to say that Post's thesis marks the beginning of proof theory»[>].
    • Logic, 1930 [<>]: Haskell Curry's thesis (supervised by Hilbert[<]) Grundlagen der kombinatorischen Logik.
      Curry's main work was in mathematical logic with particular interest in the theory of formal systems and processes. He formulated a logical calculus using inferential rules.
      His non-Hilbterian formalist philosophy of mathematics «depends on a historical thesis that as a branch of mathematics develops, it becomes more and more rigorous in its methodology, the end-result being the codification of the branch in formal deductive systems. Curry claimed that assertions of a mature mathematical theory should be construed not so much as the results of moves in a particular formal deductive system ... but rather as assertions about a formal system. ... For Curry, then, mathematics is an objective science, and it has a subject matter -- formal systems. In effect, mathematics is metamathematics.» [x].
    • Comp. Theory + Encod., 1931 [<>]: Kurt Gödel shows the incompleteness of any consistent axiomatization of arithmetics (or classical analysis, set theory, or other sufficiently rich formal systems [x]) -- the own consistency cannot be derived from/within itself (let alone in a finitary fragment, as Hilbert[< had stipulated). Gödel used an encoding of formulae as numbers (Gödel numbering), and of function on them as logical operations. This result raised questions about the encoding of formulae and the computability of deductions in the middel of the 1930s. «There were a number of characterizations of computability, developed more or less independently, by logicians like Gödel (recursiveness), Post, Church (lambda-definability), Kleene, Turing (the Turing machine), and Markov (the Markov algorithm).» [x].
    • Encod., early 1930: CCITT's 5-bit ITA2 (International Telegraph Alphabet #2), modifying Western Union's Murray code, with SPACE, BEL [</>].
      Used to "read" programs of the Manchester/Ferranti Mark 1.
      Based on ITA2: 6-bit CCITT#4 code, 6-bit TTS (teletypesetting) code, 6-bit+parity codes, and 7-bit code with always 4 bits on.
      7-bit CCITT#3 code with always 3 bits on, a variation of Moore code.
    • PL, 1932: K Menger's rules of spelling for the paranthesis-free notation [CC].
    • Commerce, early 30's: IBM's 90% monopoly on puch card systems.
      1932-36: Antitrust case about punch card machines against IBM and Remington-Rand.
    • Theory, 30's: Abstract lattice theory (Birkhoff et.al.) [Math]
    • Calculator, 1933: Mallock Machine, an electrical analog [Differential Analyzer/Manchaster] calculating device [Fahrdiagraph/with relays] to solve linear simultaneous equations.
    • Cyber, 1933[<]: W B Cannon's concept of "homoeostasis" (of an organism's inner milieu) [SuB 136]. Cf. homoeostatic meshs 1961.
    • Meaning, when? [<>]: Louis Hjelmslev's (Danish linguist 1899-1965) distinction of the meaning of signifiers into denotative (Saussure's signified) and connotative [Sem].
    • Syntax, 1933[<>]: Bloomfeld's analysis of sentences' constituent structure
    • Syntax, 1934[<>]: Stephen C Kleene's (USA) [>] rules of spelling for formulae with paranthesis in most general form [CC].
    Principle, 1934 [<]: Binary Logic - Arithmetics not by counting but by logic operations [<>] on binary numbers. Note that older telegraph terminology talked of marks and spaces instead of bits.
  • Attanasoff's idea (in a tavern) of using base-two numbers for electronic computing by direct logical action and not by enumeration
  • Zuse's considerations started in 1934 lead to the hypothesis "data processing starts with the bit" (which he called "yes/no status" at that time, and wrote "+"/"-" in his 1945 Plankalkül).
    • 1934/35 [<>]: Gerhard Gentzen (German logician, 1909-1945), «in his fundamental paper of 1935, expounded a radically new way of formalizing logic - natural deduction, which he carried out for both classical and intuitionistic first-order logic.» Natural deduction, the first non-axiomatic formalization of logic, was «introduced independently by S Jaskowski in 1934 and Gerhard Gentzen in 1935» [x]. «All previous mathematical logicians - including Frege, Russell and Whitehead, Hilbert, and Heyting (intuitionism, mathematical) - had formalized logic axiomatically, their method being modelled on the misleading analogy of formal theories. In these formalizations, certain logically valid formulae were assumed as axioms, from which a minimum of rules of derivation preserving logical validity yielded the rest. This older method required ad hoc definitions of derivability from a set of premisses (since not all rules of derivation preserved truth under a given interpretation of the schematic letters); it often demanded much ingenuity to obtain the formal theorems. Worse, it concentrated philosophical and logical attention on the notion of logical truth in place of that of logical consequence. »
      «In the same paper, Gentzen developed another method of formalization, a sequent calculus» [x]. «He showed that any proof in either of these systems can be converted to a proof in the other. His cut elimination theorem - still undoubtedly the best theorem in proof theory - showed that any sequent calculus proof can be converted into a tableau (or truth-tree) in which formulae are steadily broken down, not built up.» [x].
      With this, proof theory[<] is usually reckoned to begin as a discipline in its own right.
    Symbolism/Principle: Complete symbol manipulation systems for calculations
    • Marvin Camras's magnetic recording techniques
    • Classific., when? [<>]: Wittgenstein's question: what is the criterion for the class of games or work of art [CvP]? There is no sharp criterion, only a similarity in various, varying sets of features. - Concepts are characterized by family resemblance. «Except for technical terms in mathematics, Wittgenstein maintained that for most concepts, meaning is determined not by definition, but by family resemblance. Such terms can be defined only in terms of similarities and representative "prototypes"». This sparked research into prototypes (JL Austin, L Zadeh, F Lounsbury), resulting in "prototype theory" [>].
    3rd Age of Logic[<]:   Modern Logic (with Dominance of First Order Logic)   (1930s-present)

    TODO: On How Logic Became First-order


    home Biological until 1854 Formalization 1854-1937 Revolutions 1937-1951 Electronic Age references
    Location: http://members.tripod.de/s_ulf/csh/formal.html & http://www.cs.mun.ca/~ulf/csh/formal.html. By Ulf Schünemann since 251198. Please mail any comments.