Human centered design thinking approach for an AI based healthcare application

This paper proposed a human-centred design thinking approach for developing an AI-based healthcare application. By empathising with patients and clinicians, defining the right problem, deciding the division of work between AI and humans, prototyping early and testing repeatedly, designers can build applications that are not only technically capable but also safe, understandable, fair and useful in real care settings. Future work should implement a prototype following this framework, compare different modelling techniques, and evaluate the effect on clinical outcomes, clinician workload, engagement and fairness with real users.

Altman, M., Huang, T. T. K., & Breland, J. Y. (2018). Design thinking in health care. Preventing Chronic Disease, 15, Article 180128. Amershi, S., Weld, D., Vorvoreanu, M., et al. (2019). Guidelines for human-AI interaction. In Proceedings of CHI 2019. ACM. Beede, E., Baylor, E., Hersch, F., et al. (2020). A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In Proceedings of CHI 2020. ACM. Brooke, J. (1996). SUS: A quick and dirty usability scale. In P. W. Jordan et al. (Eds.), Usability evaluation in industry (pp. 189–194). Taylor & Francis. Brown, T. (2008). Design thinking. Harvard Business Review, 86(6), 84–92. Cai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019). “Hello AI”: Uncovering the onboarding needs of medical practitioners for human-AI collaborative decision-making. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), Article 104. Deci, E. L., & Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227–268. Dorst, K. (2011). The core of ‘design thinking’ and its application. Design Studies, 32(6), 521–532. Esteva, A., Robicquet, A., Ramsundar, B., et al. (2019). A guide to deep learning in healthcare. Nature Medicine, 25(1), 24–29. Floridi, L., Cowls, J., Beltrametti, M., et al. (2018). AI4People: An ethical framework for a good AI society. Minds and Machines, 28(4), 689–707. Gulshan, V., Peng, L., Coram, M., et al. (2016). Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA, 316(22), 2402–2410. Holden, R. J., & Karsh, B.-T. (2010). The technology acceptance model: Its past and its future in health care. Journal of Biomedical Informatics, 43(1), 159–172.