Diversity in logarithmic opinion polls

• Autores: Andrew Smith, Miles Osborne
• Localización: Linguisticae investigationes: Revue internationale de linguistique française et de linguistique générale, ISSN 0378-4169, Tome 30, Fascicule 1, 2007, págs. 27-47
• Idioma: inglés
• Texto completo no disponible (Saber más ...)
• Resumen

  • Conditional random fields are state-of-the-art models for sequencing tasks such as named entity recognition. However, being globally conditioned, they have a tendency to overfit to a greater extent than other sequencing models. We introduce an approach to combat this overfitting called a logarethmic opinion pool (LOP). A LOP consists of a weighted combination of constituent models. We present the theory behind LOPs, and show that effective LOPs require constituent models that are diverse from one another. We examine different ways to introduce such diversity, including an approach that involves training the constituent models together, interactively. Our results show that, as expected from the underlying theory, explicity optimising for constituent model diversity can improve performance over standard approaches to regularisation