Towards a rule-based Spanish to Spanish sign language translation: from written forms to phonological representations

• Autores: Jordi Porta Zamorano
• Directores de la Tesis: José Colás Pasamontes (dir. tes.), Fernando Jesús López Colino (dir. tes.)
• Lectura: En la Universidad Autónoma de Madrid ( España ) en 2014
• Idioma: inglés
• Tribunal Calificador de la Tesis: Mikel L. Forcada Zubizarreta (presid.), Pilar Rodríguez Marín (secret.), Núria Bel Rafecas (voc.), Horacio Rodríguez Hontoria (voc.), Josep Quer (voc.)
• Materias:
  • Lingüística
    • Lingüística aplicada
      • Traducción automática
  • Sociología
    • Comunicaciones sociales
      • Signos
• Enlaces
  • Tesis en acceso abierto en: Biblos-e Archivo
• Resumen

  • This thesis addresses several aspects about the automatic translation from Castilian Spanish to Spanish Sign Language (LSE), two typologically distant languages with not enough linguistics resources enabling statistical approaches to translation. For this reason, a rule-based approach grounded on contrastive grammatical studies on both languages is used.

    An architecture following the analysis, transfer and generation model has been chosen. Transfer is performed at the grammatical function level, which is delivered by a Spanish dependency parser without incurring into the complexities of a more deeper analysis.

    The bilingual base lexicon is obtained from the Diccionario normativo de la lengua de signos española (DILSE-III), which contains the correspondences between Spanish lemmas and their SEA (Sistema de escritura alfabética) representation of signs. The lexicon is extended in two different ways: taking advantage of the difference in flexibility between the part-of-speech systems of Spanish and LSE and exploiting several lexical semantic relations, such as synonymy, hyponymy and meronymy.

    During the structural transfer phase, some nodes of the dependency analysis are transformed, others are removed and new nodes are inserted. Some classifier predicates are generated in this phase. Surface order generation of signs is obtained by means of the topological ordering of the graph of precedence relations between signs. Pairs of signs having head-dependent relations or sharing the same head are examined in order to determine if its relative ordering is marked or not. The system is evaluated at this point and results are compared to those obtained with statistical models. Best results are obtained with the rule-based approach, with a 0.30 BLEU (Bilingual Evaluation Understudy) and a 42% TER (Translation Error Rate). A linguistic-oriented analysis of errors is provided.

    Finally, in the morphological generation phase, glosses with morphological annotations are replaced by the HamNoSys (Hamburg Sign Language Notation System) phonological representations produced by a computational morphology. These representations are used for animation synthesis with avatars. The computational morphology that has been implemented uses inflection, introflection and suppletion to model a significant fragment of the LSE morphology. Among the phenomena considered, it has been implemented deictics, nominal plural, aspect marking, verbal agreement, adjectival modification and degree.