Language processing in real and artifical neural networks

William S-Y Wang,Chun Kit Wong
2009-01-01
Abstract:The first part of this thesis reports a computational simulation work on modelling language processing. The motivation was from a study that attempted to show that contemporary connectionist models, the simple recurrent networks being the exemplar, fail to exhibit a kind of generalisation that is essential for acquiring natural language. A replication of the simulation, however, revealed a pattern that was to the contrary. I extended the simulation to investigate the plausible causes of the discrepancies and I argued that generalisation is possible in connectionist models as long as the knowledge of categories is successfully induced by the networks.The second part of the thesis reports an investigation of how the real brain functions during tasks of language processing. To be more specific, during a task of reading for comprehension. I employed a high temporal resolution brain imaging technique known as electroencephalography (EEG), through which the electrical potentials, in terms of micro-volts, as a consequence of participants' engagement of the reading task were measured from electrodes that were placed on their scalps. Event-related-potentials (ERPs), also referred to as "brain waves", were then derived from these measured time series of voltages. In this ERP study of reading, I identified the earliest brain responses to semantic processing and I argued that within one fifth of a second the brain has already started to process the meanings of a word. Despite the fact that the two parts of the thesis represent research work of two different disciplines, the central theme of my thesis remains clear – to study how language is possible in a brain.
What problem does this paper attempt to address?