ANN Models for language acquisition

Source: http://www.lsi.upc.edu/~jpoveda/publications/ideal06.pdf
Jordi Poveda,  Alfredo Velidodo from Technical University of Catalonia (UPC), Barcelona, Spain
Nativists: Chomsky, Fodor and Pinker
Non-nativists: Mac Whinney, Bates and Snow (among them)

Probabilistic interpretation of neural networks:

1. MacKay, D. J. C.: Bayesian Methods for Back-propagation Networks. In Domany,   E., van Hemmen, J. L., and Schulten, K. (eds.), Models of Neural Networks III, Ch.   6 (1994). Springer, New York.

2. Neal, R.: Bayesian Learning for Neural Networks, PhD thesis (1994). University of  Toronto, Canada

3. Bishop, C.: Neural Networks for Pattern Recognition (1995). Oxford University
   Press, New York

4. Friston, K.: A Theory of Cortical Responses. Philosophical Transactions of the Royal Society, B, 360(2005)

Artificial Neural Network Architectures for Language Acquisition:
1. Kohonen Self-Organizing Maps
Results:  Anderson, B.: Kohonen Neural Networks and Language. Brain and Language,  (1999) 86-94
2. Elman's SRN for Building Word Meaning Representations
Description:  Distributed representations (i.e. as a vector of weights) for the meaning of a word. The word meaning representations are built
from contextual features, by putting the word in relation to its context, as it
occurs in a stream of input sentences. This is indeed what Li and Farkas do in
the WCD (Word Co-ocurrence Detector) subsystem of their DevLex and
SOMBIP models
Results:  Elman, J. L.: Finding Structure in Time. Cognitive Science, 14 (1990) 179-211



 Models:
1.  Rumelhart, D., McClelland, J.: On the Learning of the Past Tenses of English Verbs. Parallel distributed processing: Explorations in the microstructure of cognition (1986)
2. TRACE: McClelland, J. L., Elman, J. L.: Interactive Processes in Speech Perception: The  TRACE Model. Parallel distributed processing (1986)
3. SOMBIP: A Model of Bilingual Lexicon Acquisition
Li, P., Farkas, I.: A Self-Organizing Connectionist Model of Bilingual Processing.
Bilingual Sentence Processing (2002)
4. DevLex: A Model of Early Lexical Acquisition
Li, P., Farkas, I., MacWhinney, B.: Early Lexical Development in a Self-Organizing Neural Network. Neural Networks (2004)