A Method for Studying Semantic Construal in Grammatical Constructions with Interpretable Contextual Embedding Spaces

Gabriella Chronis, Kyle Mahowald, Katrin Erk

Main: Linguistic Theories, Cognitive Modeling, and Psycholinguistics Main-oral Paper

Session 5: Linguistic Theories, Cognitive Modeling, and Psycholinguistics (Oral)
Conference Room: Pier 7&8
Conference Time: July 11, 16:15-17:30 (EDT) (America/Toronto)
Global Time: July 11, Session 5 (20:15-21:30 UTC)
Keywords: linguistic theories
TLDR: We study semantic construal in grammatical constructions using large language models. First, we project contextual word embeddings into three interpretable semantic spaces, each defined by a different set of psycholinguistic feature norms. We validate these interpretable spaces and then use them to ...
You can open the #paper-P2186 channel in a separate window.
Abstract: We study semantic construal in grammatical constructions using large language models. First, we project contextual word embeddings into three interpretable semantic spaces, each defined by a different set of psycholinguistic feature norms. We validate these interpretable spaces and then use them to automatically derive semantic characterizations of lexical items in two grammatical constructions: nouns in subject or object position within the same sentence, and the AANN construction (e.g., `a beautiful three days'). We show that a word in subject position is interpreted as more agentive than the very same word in object position, and that the nouns in the AANN construction are interpreted as more measurement-like than when in the canonical alternation. Our method can probe the distributional meaning of syntactic constructions at a templatic level, abstracted away from specific lexemes.