[Paper Review] Letter counting: a stem cell for Cryptology, Quantitative Linguistics, and Statistics

Bernard Ycart|arXiv (Cornell University)|Nov 29, 2012

Authorship Attribution and Profiling19 references3 citations

TL;DR

This paper explores letter counting as a foundational analytical method that underpins Cryptology, Quantitative Linguistics, and Statistics. It traces historical roots from ancient frequency analysis in cryptography to Markov’s use of vowel-consonant alternations in stochastic processes, demonstrating how letter counting enabled cross-disciplinary advances through shared methodological principles and scholarly eclecticism.

ABSTRACT

Counting letters in written texts is a very ancient practice. It has accompanied the development of Cryptology, Quantitative Linguistics, and Statistics. In Cryptology, counting frequencies of the different characters in an encrypted message is the basis of the so called frequency analysis method. In Quantitative Linguistics, the proportion of vowels to consonants in different languages was studied long before authorship attribution. In Statistics, the alternation vowel-consonants was the only example that Markov ever gave of his theory of chained events. A short history of letter counting is presented. The three domains, Cryptology, Quantitative Linguistics, and Statistics, are then examined, focusing on the interactions with the other two fields through letter counting. As a conclusion, the eclectism of past centuries scholars, their background in humanities, and their familiarity with cryptograms, are identified as contributing factors to the mutual enrichment process which is described here.

Motivation & Objective

• To examine the historical role of letter counting in shaping key developments across cryptology, quantitative linguistics, and statistics.
• To highlight how early scholars' interdisciplinary backgrounds in humanities and cryptography fostered methodological convergence.
• To analyze the mutual enrichment between the three fields through shared reliance on letter frequency and sequence analysis.
• To illustrate how letter counting served as a 'stem cell'—a foundational technique that generated diverse, advanced applications.
• To emphasize the significance of historical scholars' familiarity with cryptograms and linguistic patterns in enabling cross-field innovation.

Proposed method

• Tracing the historical evolution of letter counting from ancient practices to modern statistical applications.
• Analyzing frequency analysis in cryptology as a core technique for breaking classical ciphers.
• Examining early quantitative studies of vowel-to-consonant ratios in different languages as precursors to authorship attribution.
• Reviewing Markov’s use of vowel-consonant alternations as a canonical example in his theory of Markov chains.
• Identifying cross-field interactions through shared analytical frameworks centered on letter sequences and frequencies.
• Using archival and scholarly sources to reconstruct the intellectual lineage connecting cryptanalysis, linguistic statistics, and stochastic processes.

Experimental results

Research questions

• RQ1 How did letter counting contribute to the development of classical cryptanalysis?
• RQ2 In what ways did early quantitative linguistics rely on letter frequency distributions before the advent of computational methods?
• RQ3 How did Markov’s theory of dependent events originate from the analysis of vowel-consonant alternations in texts?
• RQ4 What role did interdisciplinary scholarship—particularly in humanities and cryptography—play in advancing statistical and linguistic analysis?
• RQ5 Why is letter counting considered a foundational or 'stem cell' method in the development of multiple quantitative disciplines?

Key findings

• Letter counting was instrumental in the development of frequency analysis, the cornerstone of classical cryptology.
• Early studies of vowel-to-consonant ratios in different languages predated modern authorship attribution and contributed to quantitative linguistics.
• Markov’s seminal work on stochastic processes was motivated by the alternation of vowels and consonants in Alexander Pushkin’s text.
• The convergence of cryptology, quantitative linguistics, and statistics was enabled by shared methodological roots in letter frequency and sequence analysis.
• Historical scholars often had dual expertise in humanities and cryptography, which facilitated the cross-pollination of ideas across disciplines.
• Letter counting exemplifies a 'stem cell' method—simple in form but generative of complex, advanced analytical techniques across multiple fields.