jump to navigation

Understanding connectionism December 5, 2006

Posted by Johan in Connectionism, Neural Networks, Raves.

Like many Psychologists, equations make me a little uneasy. So connectionist models are typically not my choice of reading, when I have a choice in the matter. This is a shame really, because these models tend to be extremely powerful: with a relatively simple model, complex phenomena can be explained in a framework that maps closely on to what is known about how the brain works.

Take McClelland’s model of memory*. Reading the original article is painful, yet, the model itself is not complicated, when presented in a different way. The Belgian Cognitive Science Research Unit has an extremely enlightening demonstration of the model, called a Tribute to Interactive Activation. Just click individual nodes of the model (to simulate activation), and see the associated nodes light up as well. Start clicking a few nodes (e.g., 40’s, married, college), and soon, one of the name nodes receives more total activation than the others. This is a pretty neat way of representating how the memory of one concept is evoked by the activation of related concepts.

This ties in with something I noticed during this term’s Perception module: a lot of these concepts are just not well explained in the traditional, academic journal style of writing. Reading something like van de Grind et al’s (2004) gains-equalisation model is quite painful. I could not grasp what was going on until I started drawing figures for myself… And I would most likely never have bothered with going that far unless the paper had carried so much promise in explaining storage of the motion after-effect, which was the topic of an assessed practical. Similar measures were necessary to process the wealth of research reviewed in Livingstone and Hubel’s (1988) paper on the perceptual properties of the magno- and parvocellular layers of the Lateral Geniculate Nucleus. No real structure emerges until you make a table and start listing the things that the article claims the different cells can and cannot do.

Some kinds of information are better conveyed through figures, animations; anything but sentences. It is a little curious that despite this, so many textbooks and articles rely almost exclusively on sheer text. Probably, the maths that so unsettle me have similarly enlightening effects on those who speak its language. Perhaps there is some truth in my girlfriend, the Biologist’s repeated, pointed remark that “you can’t be a proper scientist without knowing calculus.”

* McClelland, J.L. (1981). Retrieving general and specific information from stored knowledge of specifics. Proceedings of the Third Annual Meeting of the Cognitive Science Society, 170-172.



1. Brain Voyager: Brain Tutor - Neuroimaging for Free « The Phineas Gage Fan Club - December 9, 2006

[…] In my last post I discussed how some aspects of Psychology just aren’t well explained through long paragraphs of text. Neuroscience is certainly one example, where the location of each bit can seem more than a little abstract (which is closer to the side of the head, the medial frontal or the precentral gyrus?). A free application available for Mac, Windows and Linux comes to the rescue: Brain Voyager: Brain Tutor. The full-scale Brain Voyager program deals with visualising and analysing fMRI data. The Brain Tutor simply has one structural MRI image pre-loaded, and lets you zoom around it. It even highlights gyri, sulci, or lobes for you, as you click on them. […]

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: