Compositional Distributional Semantics with Syntactic Dependencies and Selectional Preferences

TítuloCompositional Distributional Semantics with Syntactic Dependencies and Selectional Preferences
AutoresPablo Gamallo
TipoArtículo de revista
Fonte Applied Sciences-Basel, Multidisciplinary Digital Publishing Institute (MDPI), Vol. 11, No. 5743, 2021.
AbstractThis article describes a compositional model based on syntactic dependencies which has been designed to build contextualized word vectors, by following linguistic principles related to the concept of selectional preferences. The compositional strategy proposed in the current work has been evaluated on a syntactically controlled and multilingual dataset, and compared with Transformer BERT-like models, such as Sentence BERT, the state-of-the-art in sentence similarity. For this purpose, we created two new test datasets for Portuguese and Spanish on the basis of that defined for the English language, containing expressions with noun-verb-noun transitive constructions. The results we have obtained show that the linguistic-based compositional approach turns out to be competitive with Transformer models.
Palabras chavecompositionality; dependency parsing; compositional distributional semantics