Stefan Geier's Diploma Thesis and James Deese's Butterfly Experiment: transition probabilities and triangular-tetrahedral-hexagonal cognitive-neuronal structures and artificial intelligence and neurophysiology
Stefan Geier's Diploma Thesis (LMU Munich, 1987) and James Deese's Butterfly Experiment:Transition probabilities, triangular-tetrahedral-hexagonal cognitive-neuronal structures, artificial intelligence, and neurophysiology.
(A first look)
Stefan Geier's Diploma Thesis (LMU Munich, 1987) can be compressed into one central scientific statement: cognitive structures are scale-dependent. Associative near terms and concepts are best described by transition probabilities. Distant terms and concepts in Geier's analyses of James Deese's butterfly field are best described by a triangular-tetrahedral(-hexagonal) structure, featuring Nature as the superordinate apex and Fauna, Seasons/Sun, and Colors/Sky forming the basal triangle. The hexagonal extension is a necessary consequence of the triangular, near-equilateral basic structure of the cognitive map and its geometric representation.
The thesis recognizes a completely different regime for closely associated terms. Near terms, such as bee, flower, insect, fly, bird, wing, moth, and cocoon, are not best described solely by undirected distances. Instead, they form a local, directed association field. The correct model for this is a transition probability: from stimulus i to reaction j, how often does the transition occur?
The importance of transition probabilities is not the only structural result; a tetrahedral structure with near-equilateral trinagles is also a basic feature of human associative cognitive structures:
Table of the six semantic edges from
page 75
|
Edge |
Wording on
page 75 |
Geometric
reconstruction |
Interpretive
note |
|
D1 |
"nature"
- "bees" - Fauna |
Nature to Fauna |
Apex-to-basal
edge; bees functions as bridge. |
|
D2 |
"nature"
- Jahreszeiten & Sonnenschein |
Nature to
Seasons/Sun |
Apex-to-basal
edge. |
|
D3 |
"nature"
- "flower" - "yellow" - Farben & Himmel |
Nature to
Colors/Sky |
Apex-to-basal
edge via flower/yellow. |
|
D4 |
Fauna - Farben
& Himmel |
Fauna to
Colors/Sky |
Basal edge A-C;
must be straight in the reconstruction. |
|
D5 |
Fauna -
Jahreszeiten |
Fauna to Seasons |
Basal edge A-B. |
|
D6 |
Farben &
Himmel - "yellow" - "sunshine" - Jahreszeiten |
Colors/Sky to
Seasons/Sun |
Basal edge C-B
via yellow/sunshine. |
The edge list is not a minor detail. It is the central semantic code of the tetrahedron. Edges 1, 2, and 3 are explicitly nature-conditioned; edges 4, 5, and 6 connect the other three concept regions. This is the strongest textual reason to place Nature at the special D vertex and to place Fauna, Seasons/Sun, and Colors/Sky on the basal triangular face.
Summary of the consequences of Stefan Geier's Diploma Thesis:
|
Scale |
Best description |
Why |
|
Associative near terms |
Directed
transition probabilities p(j | i) |
Local
associative motion can be asymmetric; arrow direction and strength matter. |
|
Distant concept regions |
Triangular-tetrahedral-hexagonal geometry |
Separated
clusters require a global relational map with vertices, faces, and edges. |
|
Modern AI implementation |
Probability
plus embeddings plus attention |
Large
models combine local prediction with high-dimensional relational geometry. |
This distinction is highly scientific. It
prevents a category error. Near association is dynamic and probabilistic;
distant semantic organization is geometric. A good cognitive theory needs both. Stefan Geier's thesis contains both and therefore is a basic work for artificial intelligence (AI), neuronal networks and neurophysiology.
References and context:
Banino, A., Barry, C., Uria,
B., Blundell, C., Lillicrap, T., Mirowski, P., Pritzel, A., Chadwick, M. J.,
Degris, T., Modayil, J., Wayne, G., et al. (2018). Vector-based navigation
using grid-like representations in artificial agents. Nature, 557, 429-433.
https://doi.org/10.1038/s41586-018-0102-6
Bengio, Y., Ducharme, R.,
Vincent, P., & Jauvin, C. (2003). A neural probabilistic language model.
Journal of Machine Learning Research, 3, 1137-1155.
Benzécri, J.-P. (1973).
L'Analyse des Données: Vol. 2. L'Analyse des Correspondances. Paris: Dunod.
Brown, T. B., Mann, B.,
Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., et al. (2020). Language
models are few-shot learners. Advances in Neural Information Processing
Systems, 33.
Collins, A. M., &
Quillian, M. R. (1969). Retrieval time from semantic memory. Journal of Verbal
Learning and Verbal Behavior, 8(2), 240-247.
https://doi.org/10.1016/S0022-5371(69)80069-1
Cueva, C. J., & Wei,
X.-X. (2018). Emergence of grid-like representations by training recurrent
neural networks to perform spatial localization. International Conference on
Learning Representations. arXiv:1803.07770. https://arxiv.org/abs/1803.07770
Deerwester, S., Dumais, S.
T., Furnas, G. W., Landauer, T. K., & Harshman, R. (1990). Indexing by
latent semantic analysis. Journal of the American Society for Information
Science, 41(6), 391-407.
Deese, J. (1959). Influence
of inter-item associative strength upon immediate free recall. Psychological
Reports, 5(3), 305-312. https://doi.org/10.2466/pr0.1959.5.3.305
Deese, J. (1965). The
Structure of Associations in Language and Thought. Baltimore: The Johns Hopkins
Press.
Fyhn, M., Hafting, T.,
Treves, A., Moser, M.-B., & Moser, E. I. (2007). Hippocampal remapping and
grid realignment in entorhinal cortex. Nature, 446, 190-194.
https://doi.org/10.1038/nature05601
Fyhn, M., Molden, S., Witter,
M. P., Moser, E. I., & Moser, M.-B. (2004). Spatial representation in the
entorhinal cortex. Science, 305(5688), 1258-1264.
https://doi.org/10.1126/science.1099901
Geier, S. A. (1987). Korrespondenz- & Kontingenzanalyse. Diploma Thesis, Ludwig-Maximilians-Universitaet Muenchen.
Greenacre, M. J. (1984).
Theory and Applications of Correspondence Analysis. London: Academic Press.
Hafting, T., Fyhn, M.,
Molden, S., Moser, M.-B., & Moser, E. I. (2005). Microstructure of a
spatial map in the entorhinal cortex. Nature, 436, 801-806.
https://doi.org/10.1038/nature03721
Hill, M. O. (1974).
Correspondence analysis: A neglected multivariate method. Journal of the Royal
Statistical Society. Series C (Applied Statistics), 23(3), 340-354.
https://doi.org/10.2307/2347127
Kruskal, J. B. (1964).
Multidimensional scaling by optimizing goodness of fit to a nonmetric
hypothesis. Psychometrika, 29(1), 1-27. https://doi.org/10.1007/BF02289565
LeCun, Y., Bengio, Y., &
Hinton, G. (2015). Deep learning. Nature, 521, 436-444.
https://doi.org/10.1038/nature14539
Mikolov, T., Chen, K.,
Corrado, G., & Dean, J. (2013). Efficient estimation of word
representations in vector space. arXiv:1301.3781.
https://doi.org/10.48550/arXiv.1301.3781
Moser, E. I. (2014). Grid
cells and the entorhinal map of space. Nobel Lecture, 7 December 2014.
NobelPrize.org.
https://www.nobelprize.org/prizes/medicine/2014/edvard-moser/lecture/
Moser, E. I., Kropff, E.,
& Moser, M.-B. (2008). Place cells, grid cells, and the brain's spatial
representation system. Annual Review of Neuroscience, 31, 69-89.
https://doi.org/10.1146/annurev.neuro.31.061307.090723
Moser, E. I., Roudi, Y.,
Witter, M. P., Kentros, C., Bonhoeffer, T., & Moser, M.-B. (2014). Grid
cells and cortical representation. Nature Reviews Neuroscience, 15, 466-481.
https://doi.org/10.1038/nrn3766
Moser, M.-B. (2014). Grid
cells, place cells and memory. Nobel Lecture, 7 December 2014. NobelPrize.org.
https://www.nobelprize.org/prizes/medicine/2014/may-britt-moser/lecture/
O'Keefe, J., &
Dostrovsky, J. (1971). The hippocampus as a spatial map: Preliminary evidence
from unit activity in the freely moving rat. Brain Research, 34(1), 171-175.
https://doi.org/10.1016/0006-8993(71)90358-1
O'Keefe, J., & Nadel, L.
(1978). The Hippocampus as a Cognitive Map. Oxford: Oxford University Press.
Osgood, C. E., Suci, G. J.,
& Tannenbaum, P. H. (1957). The Measurement of Meaning. Urbana: University
of Illinois Press.
Rosch, E., & Mervis, C.
B. (1975). Family resemblances: Studies in the internal structure of
categories. Cognitive Psychology, 7(4), 573-605.
https://doi.org/10.1016/0010-0285(75)90024-9
Rumelhart, D. E., Hinton, G.
E., & Williams, R. J. (1986). Learning representations by back-propagating
errors. Nature, 323, 533-536. https://doi.org/10.1038/323533a0
Sargolini, F., Fyhn, M.,
Hafting, T., McNaughton, B. L., Witter, M. P., Moser, M.-B., & Moser, E. I.
(2006). Conjunctive representation of position, direction, and velocity in
entorhinal cortex. Science, 312(5774), 758-762. https://doi.org/10.1126/science.1125572
Schönpflug, W., & Schönpflug, U. (1983). Allgemeine Psychologie. Urban Schwarzenberg. Cited according to Stefan Geier's Diploma Thesis. Association-network example cited by Geier (1987, Fig. 5.3, p. 71; original cited there as p. 138).
Shannon, C. E. (1948). A
mathematical theory of communication. Bell System Technical Journal, 27,
379-423 and 623-656.
Shepard, R. N. (1980).
Multidimensional scaling, tree-fitting, and clustering. Science, 210(4468),
390-398. https://doi.org/10.1126/science.210.4468.390
Stensola, H., Stensola, T.,
Solstad, T., Frøland, K., Moser, M.-B., & Moser, E. I. (2012). The
entorhinal grid map is discretized. Nature, 492, 72-78.
https://doi.org/10.1038/nature11649
Stensola, T., Stensola, H.,
Moser, M.-B., & Moser, E. I. (2015). Shearing-induced asymmetry in
entorhinal grid cells. Nature, 518, 207-212.
https://doi.org/10.1038/nature14151
Tolman, E. C. (1948).
Cognitive maps in rats and men. Psychological Review, 55(4), 189-208.
https://doi.org/10.1037/h0061626
Tversky, A. (1977). Features
of similarity. Psychological Review, 84(4), 327-352.
https://doi.org/10.1037/0033-295X.84.4.327
Vaswani, A., Shazeer, N.,
Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., &
Polosukhin, I. (2017). Attention is all you need. Advances in Neural
Information Processing Systems, 30. arXiv:1706.03762.
Kommentare
Kommentar veröffentlichen