2026/01/27
Module 1 - From Borges to Shannon
Some pointers to the Jorge Luis Borges stories we discussed in class.
The Library of Babel
The Garden of Forking Paths
Interview with Jorge Luis Borges Borges' biography.
Information Basics
"The heart of his theory is a simple but very general model of communication: A transmitter encodes information into a signal, which is corrupted by noise and then decoded by the receiver. Despite its simplicity, Shannon’s model incorporates two key insights: isolating the information and noise sources from the communication system to be designed, and modeling both of these sources probabilistically. He imagined the information source generating one of many possible messages to communicate, each of which had a certain probability. The probabilistic noise added further randomness for the receiver to disentangle." Full article @ Quanta Magazine.
Predicting Entropy Game Demo. Refining the Estimated Entropy of English by Shannon Game Simulation. Shannon's calculations of entropy of English.
Prediction and Entropy of Languages Wolfram Demo
An experimental estimation of the entropy of English, in 50 lines of Python code
Letter frequency in English
Word and Letter Frequency in English
Entropy of English. .
Text Mechanic - Text Manipulation Tools
Shuffle Letters and Narakeet.
Using Information Theory to Solve Wordle.
1952 – “Theseus” Maze-Solving Mouse @ cyberneticzoo.com
The Library of Babel
The Garden of Forking Paths
Interview with Jorge Luis Borges Borges' biography.
"The heart of his theory is a simple but very general model of communication: A transmitter encodes information into a signal, which is corrupted by noise and then decoded by the receiver. Despite its simplicity, Shannon’s model incorporates two key insights: isolating the information and noise sources from the communication system to be designed, and modeling both of these sources probabilistically. He imagined the information source generating one of many possible messages to communicate, each of which had a certain probability. The probabilistic noise added further randomness for the receiver to disentangle." Full article @ Quanta Magazine.
Predicting Entropy Game Demo. Refining the Estimated Entropy of English by Shannon Game Simulation. Shannon's calculations of entropy of English.
Prediction and Entropy of Languages Wolfram Demo
An experimental estimation of the entropy of English, in 50 lines of Python code
Letter frequency in English
Word and Letter Frequency in English
Entropy of English. .
Text Mechanic - Text Manipulation Tools
Shuffle Letters and Narakeet.
Using Information Theory to Solve Wordle.
Claude Shannon Demonstrating Theseus
Labels: #Borges, #information, #Shannon
