Generalization at Retrieval Using Associative Networks with Transient Weight Changes
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Shabahang, Kevin D. | - |
dc.contributor.author | Yim, Hyungwook | - |
dc.contributor.author | Dennis, Simon J. | - |
dc.date.accessioned | 2022-07-06T08:36:45Z | - |
dc.date.available | 2022-07-06T08:36:45Z | - |
dc.date.created | 2022-04-06 | - |
dc.date.issued | 2022-03 | - |
dc.identifier.issn | 2522-087X | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/139279 | - |
dc.description.abstract | Without having seen a bigram like “her buffalo”, you can easily tell that it is congruent because “buffalo” can be aligned with more common nouns like “cat” or “dog” that have been seen in contexts like “her cat” or “her dog”—the novel bigram structurally aligns with representations in memory. We present a new class of associative nets we call Dynamic-Eigen-Nets, and provide simulations that show how they generalize to patterns that are structurally aligned with the training domain. Linear-Associative-Nets respond with the same pattern regardless of input, motivating the introduction of saturation to facilitate other response states. However, models using saturation cannot readily generalize to novel, but structurally aligned patterns. Dynamic-Eigen-Nets address this problem by dynamically biasing the eigenspectrum towards external input using temporary weight changes. We demonstrate how a two-slot Dynamic-Eigen-Net trained on a text corpus provides an account of bigram judgment-of-grammaticality and lexical decision tasks, showing it can better capture syntactic regularities from the corpus compared to the Brain-State-in-a-Box and the Linear-Associative-Net. We end with a simulation showing how a Dynamic-Eigen-Net is sensitive to syntactic violations introduced in bigrams, even after the associations that encode those bigrams are deleted from memory. Over all simulations, the Dynamic-Eigen-Net reliably outperforms the Brain-State-in-a-Box and the Linear-Associative-Net. We propose Dynamic-Eigen-Nets as associative nets that generalize at retrieval, instead of encoding, through recurrent feedback. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | Springer | - |
dc.title | Generalization at Retrieval Using Associative Networks with Transient Weight Changes | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Yim, Hyungwook | - |
dc.identifier.doi | 10.1007/s42113-022-00127-4 | - |
dc.identifier.scopusid | 2-s2.0-85125639593 | - |
dc.identifier.bibliographicCitation | Computational Brain and Behavior, v.5, no.1, pp.124 - 155 | - |
dc.relation.isPartOf | Computational Brain and Behavior | - |
dc.citation.title | Computational Brain and Behavior | - |
dc.citation.volume | 5 | - |
dc.citation.number | 1 | - |
dc.citation.startPage | 124 | - |
dc.citation.endPage | 155 | - |
dc.type.rims | ART | - |
dc.type.docType | Article in Press | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scopus | - |
dc.subject.keywordAuthor | Auto-associative | - |
dc.subject.keywordAuthor | Content addressable memory | - |
dc.subject.keywordAuthor | Generalization | - |
dc.subject.keywordAuthor | Pattern-completion | - |
dc.subject.keywordAuthor | Recurrent neural network | - |
dc.subject.keywordAuthor | Short-term-plasticity | - |
dc.identifier.url | https://link.springer.com/article/10.1007/s42113-022-00127-4 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.