← Back

FIFTEEN: The Transformer

“Words themselves meant nothing: in isolation, they were arbitrary collections of sounds. The only way to capture their meaning was to draw links between them and other words in the text. So if you had a knowledge graph linking the words “hop,” “green,” “tongue,” “flies,” and “amphibian,” then you knew enough to guess that the word in the center was “frog.” Not only that, but the graph should look the same in German, French, Swahili, or Vietnamese. The word wasn’t the letters “f,” “r,” “o,” and “g”—those letters were just placeholders. The word, in a cognitive sense, was that unique map of links to the rest of the vocabulary.