Evaluating Strategies for Selecting Test Datasets in Recommender Systems

• Francisco Pajuelo-Holguera ^[1] ; Gómez-Pulido, Juan A. ^[1] ; Fernando Ortega ^[2]
  1. [1] Universidad de Extremadura

     Universidad de Extremadura

     Badajoz, España

     
  2. [2] Universidad Politécnica de Madrid

     Universidad Politécnica de Madrid

     Madrid, España

     
• Localización: Hybrid Artificial Intelligent Systems. 14th International Conference, HAIS 2019: León, Spain, September 4–6, 2019. Proceedings / coord. por Hilde Pérez García, Lidia Sánchez González, Manuel Castejón Limas, Héctor Quintián Pardo, Emilio Santiago Corchado Rodríguez, 2019, ISBN 978-3-030-29858-6, págs. 243-253
• Idioma: inglés
• Enlaces
  • Texto completo
• Resumen

  • Recommender systems based on collaborative filtering are widely used to predict users’ behaviour in large databases, where users rate items. The prediction model is built from a training dataset according to matrix factorization method and validated using a test dataset in order to measure the prediction error. Random selection is the most simple and instinctive way to build test datasets. Nevertheless, we could think about other deterministic methods to select test ratings uniformly along the database, in order to obtain a balanced contribution from all the users and items. In this paper, we perform several experiments of validating recommender systems using random and deterministic strategies to select test datasets. We considered a zigzag deterministic strategy that selects ratings uniformly across the rows and columns of the ratings matrix, following a diagonal path. After analysing the statistical results, we conclude that there are no particular advantages in considering the deterministic strategy.