%0 Journal Article %T Empirical Comparison of Evaluation Methods for Unsupervised Learning of Morphology Comparaison empirique des m¨¦thodes d'¨¦valuation de l'apprentissage non-supervis¨¦ de la morphologie %A Sami Virpioja %A Ville T. Turunen %A Sebastian Spiegler %A Oskar Kohonen %J Traitement Automatique des Langues %D 2012 %I Association pour le Traitement Automatique des Langues (ATALA) %X Unsupervised and semi-supervised learning of morphology provide practical solutions for processing morphologically rich languages with less human labor than the traditional rule-based analyzers. Direct evaluation of the learning methods using linguistic reference analyses is important for their development, as evaluation through the final applications is often time consuming. However, even linguistic evaluation is not straightforward for full morphological analysis, because the morpheme labels generated by the learning method can be arbitrary. We review the previous evaluation methods for the learning tasks and propose new variations. In order to compare the methods, we perform an extensive meta-evaluation using the large collection of results from the Morpho Challenge competitions. %K morphology %K evaluation %K unsupervised learning %U http://www.atala.org/IMG/pdf/2-Virpioja-TAL52-2-2011.pdf