Sequential Usage Patterns in Collaborative Ontology-Engineering Projects

With the growing popularity of large-scale biomedical collaborative ontology-engineering projects, such as the creation of the 11th revision of the International Classification of Diseases, new methods and insights are needed to help project- and community-managers to cope with the constantly growing complexity of such projects. In this paper we present a novel application of Markov Chains on the change-logs of collaborative ontology-engineering projects to extract and analyze sequential patterns. This method also allows to investigate memory and structure in human activity patterns when collaboratively creating an ontology by leveraging Markov Chain models of varying orders. We describe all necessary steps for applying the methodology to collaborative ontology-engineering projects and provide first results for the International Classification of Diseases in its 11th revision. Furthermore, we show that the collected sequential-patterns provide actionable information for community- and project-managers to monitor, coordinate and dynamically adapt to the natural development processes that occur when collaboratively engineering an ontology. We hope that the adaption of the presented methodology will spur a new line of ontology-development tools and evaluation-techniques, which concentrate on the interactive nature of the collaborative ontology-engineering process.