Identification of Adjective-Noun Neologisms using Pretrained Language Models

• John P. McCrae ^[1]
  1. [1] National University of Ireland

     National University of Ireland

     Irlanda

     
• Localización: Joint Workshop on Multiword Expressions and WordNet (MWE-WN 2019): August 2, 2019 Florence, Italy: Proceedings of the Workshop / Agata Savary (ed. lit.), Carla Parra Escartín (ed. lit.), Francis Bond (ed. lit.), Jelena Mitrovic (ed. lit.), Verginica Barbu Mititelu (ed. lit.), 2019, ISBN 978-1-950737-26-0, págs. 135-141
• Idioma: inglés
• Enlaces
  • Texto completo (pdf)
• Resumen

  • Neologism detection is a key task in the constructing of lexical resources and has wider implications for NLP, however the identification of multiword neologisms has received little attention. In this paper, we show that we can effectively identify the distinction between compositional and non-compositional adjective-noun pairs by using pretrained language models and comparing this with individual word embeddings. Our results show that the use of these models significantly improves over baseline linguistic features, however the combination with linguistic features still further improves the results, suggesting the strength of a hybrid approach.