 - Last login: 7 weeks agoOgpibakr
- bigfoot is a 29 year old guy from Ohio, USA.
- Likes 417 pages, 50 videos, 41 photos • 25 fans • Received 12 reviews
- Member since Jan 26, 2008
"One cannot divine nor forecast the conditions that will make happiness; one only stumbles upon them by chance, in a lucky hour, at the world's end somewhere, and holds fast to the days, as to fortune or fame."
-Willa Cather, "le Lavandou"
Music!
Favorites » His Blog
-
-
"Uncarved block
In the days when Sussman was a novice, Minsky once came to him as he sat hacking at the PDP-6.
"What are you doing?", asked Minsky.
"I am training a randomly wired neural net to play Tic-tac-toe", Sussman replied.
"Why is the net wired randomly?", asked Minsky.
"I do not want it to have any preconceptions of how to play", Sussman said.
Minsky then shut his eyes.
"Why do you close your eyes?" Sussman asked his teacher.
"So that the room will be empty."
At that moment, Sussman was enlightened.
Unlike most traditional Zen koans, this koan has a possible concrete and correct answer: just as the room is not really empty when Minsky shuts his eyes, neither is the neural network really free of preconceptions when it is randomly wired. The network still has preconceptions, they are simply random now, and from a random rather than a human source.
Interestingly, this particular koan seems to have been closely based on a real incident; the following text extract is from Hackers: Heroes of the Computer Revolution (chapter 6):
"So Sussman began working on a program. Not long after, this odd-looking bald guy came over. Sussman figured the guy was going to boot him out, but instead the man sat down, asking, "Hey, what are you doing?" Sussman talked over his program with the man, Marvin Minsky. At one point in the discussion, Sussman told Minsky that he was using a certain randomizing technique in his program because he didn't want the machine to have any preconceived notions. Minsky said, "Well, it has them, it's just that you don't know what they are." It was the most profound thing Gerry Sussman had ever heard. And Minsky continued, telling him that the world is built a certain way, and the most important thing we can do with the world is avoid randomness, and figure out ways by which things can be planned. Wisdom like this has its effect on seventeen-year-old freshmen, and from then on Sussman was hooked.""
π
|
his Favorites
Add him as a friend >
