In this work we investigate whether the innate visual recognition and learning capabilities of untrained humans can be used in conducting reliable microscopic analysis of biomedical samples toward diagnosis. For this purpose, we designed entertaining digital games that are interfaced with artificial learning and processing back-ends to demonstrate that in the case of binary medical diagnostics decisions (e.g., infected vs. uninfected), with the use of crowd-sourced games it is possible to approach the accuracy of medical experts in making such diagnoses. Specifically, using non-expert gamers we report diagnosis of malaria infected red blood cells with an accuracy that is within 1.25% of the diagnostics decisions made by a trained medical professional.
References
[1]
Cooper S, Khatib F, Treuille A, Barbero J, Lee J, et al. (2010) Predicting protein structures with a multiplayer online game. Nature 466(7307): 756–760.
[2]
von Ahn L, Maurer B, McMillen C, Abraham D, Blum M (2008) reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science 321(5895): 1465–1468.
[3]
von Ahn L, Dabbish L (2008) Designing games with a purpose. Communications of the ACM, 58–67:
[4]
von Ahn L, Dabbish L (2004) Labeling images with a computer game. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Vienna, Austria, 319–326:
[5]
Rotman D (2009) Crowdsourcing and the question of expertise. Communications of the ACM 52(12): 12–12.
[6]
Huberman BA (2008) Crowdsourcing and Attention. Computer 41(11): 103–105.
[7]
Khatib F, Cooper S, Tyka MD, Xu K, Makedon I, et al. (2011) Algorithm discovery by protein folding game players. Proceedings of the National Academy of Sciences 108(47): 18949–18953.
Tuite K, Snavely N, Hsiao Dy, Tabing N, Popovic Z (2011) PhotoCity: training experts at large-scale image acquisition through a competitive game. In: Proceedings of the 2011 annual conference on Human factors in computing systems, Vancouver, BC, Canada, 1383–1392:
[11]
Cooper S, Treuille A, Barbero J, Leaver-Fay A, Tuite K, et al. (2010) The challenge of designing scientific discovery games. In: Proceedings of the Fifth International Conference on the Foundations of Digital Games}, Monterey, California, 40–47:
[12]
Andersen E, Liu YE, Apter E, Boucher-Genesse F, Popovi？ Z (2010) Gameplay analysis through state projection. In: Proceedings of the Fifth International Conference on the Foundations of Digital Games, Monterey, California, 1–8:
[13]
Tuite K, Snavely N, Hsiao DY, Smith AM, Popovi？ Z (2010) Reconstructing the world in 3D: bringing games with a purpose outdoors. In: Proceedings of the Fifth International Conference on the Foundations of Digital Games, Monterey, California, 232–239:
[14]
Breslauer DN, Maamari R, Switz NA, Lam WA, Fletcher D (2009) Mobile phone based clinical microscopy for global health applications. PLoS ONE 4(7).
[15]
Zhu H, Yaglidere O, Su TW, Tseng D, Ozcan A (2011) Cost-effective and compact wide-field fluorescent imaging on a cell-phone. Lab Chip 11(2): 315–322.
[16]
Miller AR, Davis GL, Oden ZM, Razavi MR, Fateh A, et al. (2010) Portable, Battery-Operated, Low-Cost, Bright Field and Fluorescence Microscope. PLoS ONE 5(8).
[17]
Bishara W, Sikora U, Mudanyali O, Su TW, Yaglidere O, et al. (2011) Holographic pixel super-resolution in portable lensless on-chip microscopy using a fiber-optic array. Lab Chip 11(7): 1276–1279.
[18]
Smith ZJ, Chu K, Espenson AR, Rahimzadeh M, Gryshuk A, et al. (2011) Cell-Phone-Based Platform for Biomedical Device Development and Education Applications. PLoS ONE 6(3).
[19]
Zhu H, Mavandadi S, Coskun AF, Yaglidere O, Ozcan A (2011) Optofluidic Fluorescent Imaging Cytometry on a Cell Phone. Analytical Chemistry 83(17): 6641–6647.
[20]
Mudanyali O, Tseng D, Oh C, Isikman SO, Sencan I, et al. (2010) Compact, light-weight and cost-effective microscope based on lensless incoherent holography for telemedicine applications. Lab Chip 10(11): 1417–1428.
[21]
Tseng D, Mudanyali O, Oztoprak C, Isikman SO, Sencan I, et al. (2010) Lensfree microscopy on a cellphone. Lab Chip 10(14): 1787–1792.
[22]
World Health Organization (2010) World Malaria Report 2010., World Health Organization.
[23]
Tek FB, Dempster AG, Kale I (2010) Parasite detection and identification for automated thin blood films malaria diagnosis. Computer Vision and Image Understanding 114: 21–32.
[24]
Tek FB, Dempster AG, Kale I (2009) Computer vision for microscopy diagnosis of malaria.
[25]
Tek FB, Dempster AG, Kale I (2006) Malaria Parasite Detection in Peripheral Blood Images. British Machine Vision.
[26]
Sio SWS, Sun W, Kumar S, Bin WZ, Tan SS, et al. (2007) MalariaCount: An image analysis-based program for the accurate determination of parasitema.
[27]
Diaz G, Gonzalez FA, Romero E (2009) A semi-automatic method for quantification and classification of erythrocytes infected with malaria parasites in microscopic images. Journal of Biomedical Informatics 42: 296–307.
[28]
Kafai YB (2006) Playing and Making Games for Learning: Instructionist and Constructionist Perspectives for Game Studies. Games and Culture 1: 36–40.
[29]
Amory A, Naicker K, Vincent J, Adams C (1999) The use of computer games as an educational tool: identification of appropriate game types and game elements. British Journal of Educational Technology 30: 311–321.
[30]
Cover TM, Thomas JA (2006) Elements of Information Theory. Wiley.
