Usability Evaluation of the Restaurant Finder Application Using Inspection and Inquiry Methods
Keywords:
usability evaluation, inspection method, inquiry method, enhanced cognitive walkthrough, system usability scale, user experience questionnaire
Abstract
Restaurant Finder application is a mobile application that helps users to find restaurants according to their requirements. One of the most well-known and widely used restaurant finder apps is Zomato. Zomato ranks first in the food and delivery category websites from around the world. But, the number of users of a product or application certainly does not guarantee the satisfaction of the user experience of apps. A system that is poorly designed will make it difficult for users, which results in the system being rarely or misused so that the costs to the organization become high and dangerous to the reputation of the company. The purpose of this study was to evaluate the usability of the restaurant finder application using inspection and inquiry methods. Inspection method using the Enhanced Cognitive Walkthrough method, and for inquiry methods using the User Experience Questionnaire method and the System Usability Scale. The inspection method results identified 7 serious problems. Recommendations for improvement based on inspection methods are focused on login tasks, reviews, and food promo information. The inquiry methods results identified 5 aspects that needed improvement. The five aspects consist of novelty, stimulation, learnability, consistency, complexity.
Downloads
Download data is not yet available.
References
Akbar, C. 2020. “Zomato Leaves Indonesia; App Remains Accessible.” (https://en.tempo.co/read/1397860/zomato-leaves-indonesia-app-remains-accessible, accessed November 20, 2020).
Alonso, A. D., Kok, S., and O’Brien, S. 2018. “Sustainable Culinary Tourism and Cevicherías: A Stakeholder and Social Practice Approach,” Journal of Sustainable Tourism (26:5), Taylor & Francis, pp. 812–831. (https://doi.org/10.1080/09669582.2017.1414224).
Bangor, A., Kortum, P. T., and Miller, J. T. 2008. “An Empirical Evaluation of the System Usability Scale,” International Journal of Human-Computer Interaction (24:6), pp. 574–594. (https://doi.org/10.1080/10447310802205776).
Bligård, L. O., and Osvalder, A. L. 2013. “Enhanced Cognitive Walkthrough: Development of the Cognitive Walkthrough Method to Better Predict, Identify, and Present Usability Problems,” Advances in Human-Computer Interaction (2013). (https://doi.org/10.1155/2013/931698).
Cinar, N. O. 2015. “USABILITY EVALUATION OF MOBILE AND DESKTOP WEBSITES: A STUDY OF COMPARING USABILITY EVALUATION METHODOLOGIES,” INSTITUTE OF MIDDLE EAST TECHNICAL UNIVERSITY.
Fernandez, A., Insfran, E., and Abrahão, S. 2011. “Usability Evaluation Methods for the Web: A Systematic Mapping Study,” Information and Software Technology (53:8), Elsevier B.V., pp. 789–817. (https://doi.org/10.1016/j.infsof.2011.02.007).
Gómez, R. Y., Caballero, D. C., and Sevillano, J.-L. 2014. “Heuristic Evaluation on Mobile Interfaces: A New Checklist.,” The Scientific World Journal (2014), p. 434326. (https://doi.org/http://dx.doi.org/10.1155/2014/434326).
Gulati, A., and Dubey, S. K. 2012. “Critical Analysis on Usability Evaluation Techniques,” International Journal of Engineering Science and Technology (IJEST) (4:3), pp. 990–997.
Gupta, S. 2015. “A Comparative Study of Usability Evaluation Methods,” International Journal of Computer Trends and Technology (22:3), pp. 103–106. (https://doi.org/10.14445/22312803/ijctt-v22p121).
Hermawan, M. A., Hidayat, N., and Setiawan, B. D. 2017. “Sistem Optimasi Rute Tempat Wisata Kuliner Di Malang Menggunakan Algoritma Bee Colony,” Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer (1:3), pp. 215–223.
Hinderks, A., Schrepp, M., and Thomaschewski, J. 2018. “A Benchmark for the Short Version of the User Experience Questionnaire,” WEBIST 2018 - Proceedings of the 14th International Conference on Web Information Systems and Technologies (Webist), pp. 373–377. (https://doi.org/10.5220/0007188303730377).
Hussain, A., and Mkpojiogu, E. O. C. 2016. “Usability Evaluation Techniques in Mobile Commerce Applications: A Systematic Review,” AIP Conference Proceedings (1761). (https://doi.org/10.1063/1.4960889).
Khajouei, R., Zahiri Esfahani, M., and Jahani, Y. 2017. “Comparison of Heuristic and Cognitive Walkthrough Usability Evaluation Methods for Evaluating Health Information Systems,” Journal of the American Medical Informatics Association (24:e1), pp. e55–e60. (https://doi.org/10.1093/jamia/ocw100).
Mahatody, T., Sagar, M., and Kolski, C. 2010. “State of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions,” International Journal of Human-Computer Interaction (26:8), pp. 741–785. (https://doi.org/10.1080/10447311003781409).
Martins, A. I., Rosa, A. F., Queirós, A., Silva, A., and Rocha, N. P. 2015. “European Portuguese Validation of the System Usability Scale (SUS),” Procedia Computer Science (67:Dsai), Elsevier Masson SAS, pp. 293–300. (https://doi.org/10.1016/j.procs.2015.09.273).
Parne, S. R. 2010. “Android Application of Restaurant Finder,” Kansas State University.
Rahadiasta, R. I., Wijoyo, S. H., and Az-Zahra, H. M. 2019. “Evaluasi User Experience Pada Game FORTNITE MOBILE Menggunakan Metode Enhanced Cognitive Walkthrough,” Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer (3:9), pp. 9114–9123.
Salunkhe, P., and Singh, N. 2019. “ZOMATO – BUSINESS MODEL AND USE OF M-COMMERCE,” Journal of the Gujarat Research Society (21:14), pp. 243–254.
Satapathy, S. C., Udgata, S. K., and Biswal, B. N. 2014. “Proceedings of the International Conference on Frontiers of Intelligent Computing: Theory and Applications (FICTA) 2013,” Advances in Intelligent Systems and Computing (247), pp. 535–543. (https://doi.org/10.1007/978-3-319-02931-3).
Scholtes, M., Noll, K., Shrabi, K., and Gross, V. 2020. “Comparison of Formative Evaluation Methods in the Usability Process on the Example of a Medical App,” in Proceedings of the 14th Health Informatics Meets Digittal Health Conference, G. Schreier, D. Hayn, and A. Eggerth (eds.), Amsterdam: IOS Press, pp. 101–107. (https://doi.org/doi:10.3233/SHTI200081).
Schrepp, M. 2019. “User Experience Questionnaire Handbook.” (https://www.ueq-online.org/Material/Handbook.pdf).
Schrepp, M., Hinderks, A., and Thomaschewski, J. 2017. “Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S),” International Journal of Interactive Multimedia and Artificial Intelligence (4:6), p. 103. (https://doi.org/10.9781/ijimai.2017.09.001).
Sharfina, Z., and Santoso, H. B. 2017. “An Indonesian Adaptation of the System Usability Scale (SUS),” in 2016 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2016, pp. 145–148. (https://doi.org/10.1109/ICACSIS.2016.7872776).
Sharma, K., and Abdul Waheed, K. 2018. “Consumption of Online Food App Services : An Exploratory Study among College Students in Dubai,” Middle East Journal of Business (13:4), pp. 4–11. (https://doi.org/10.5742/mejb.2018.93500).
Stone, M. J., Migacz, S., and Wolf, E. 2019. “Beyond the Journey: The Lasting Impact of Culinary Tourism Activities,” Current Issues in Tourism (22:2), Taylor & Francis, pp. 147–152. (https://doi.org/10.1080/13683500.2018.1427705).
Suciyono, N., Anwar, D. S., and Setyawan, E. 2019. “Pencarian Wisata Kuliner Terdekat Dengan Menggunakan Metode LBS ( Location Based Service ) Berbasis Web Mobile Di Kota Tasikmalaya,” Jurnal Voice of Informatics (8:1), pp. 67–76.
Ulinuha, H. R., Utami, E., and Sunyoto, A. 2020. “Evaluasi User Experience Pada Game Pes 2020 Menggunakan Metode Cognitive Walkthrough,” Respati (15:2), pp. 45–52.
Unrau, R., and Kray, C. 2019. “Usability Evaluation for Geographic Information Systems: A Systematic Literature Review,” International Journal of Geographical Information Science (33:4), Taylor & Francis, pp. 645–665. (https://doi.org/10.1080/13658816.2018.1554813).
Alonso, A. D., Kok, S., and O’Brien, S. 2018. “Sustainable Culinary Tourism and Cevicherías: A Stakeholder and Social Practice Approach,” Journal of Sustainable Tourism (26:5), Taylor & Francis, pp. 812–831. (https://doi.org/10.1080/09669582.2017.1414224).
Bangor, A., Kortum, P. T., and Miller, J. T. 2008. “An Empirical Evaluation of the System Usability Scale,” International Journal of Human-Computer Interaction (24:6), pp. 574–594. (https://doi.org/10.1080/10447310802205776).
Bligård, L. O., and Osvalder, A. L. 2013. “Enhanced Cognitive Walkthrough: Development of the Cognitive Walkthrough Method to Better Predict, Identify, and Present Usability Problems,” Advances in Human-Computer Interaction (2013). (https://doi.org/10.1155/2013/931698).
Cinar, N. O. 2015. “USABILITY EVALUATION OF MOBILE AND DESKTOP WEBSITES: A STUDY OF COMPARING USABILITY EVALUATION METHODOLOGIES,” INSTITUTE OF MIDDLE EAST TECHNICAL UNIVERSITY.
Fernandez, A., Insfran, E., and Abrahão, S. 2011. “Usability Evaluation Methods for the Web: A Systematic Mapping Study,” Information and Software Technology (53:8), Elsevier B.V., pp. 789–817. (https://doi.org/10.1016/j.infsof.2011.02.007).
Gómez, R. Y., Caballero, D. C., and Sevillano, J.-L. 2014. “Heuristic Evaluation on Mobile Interfaces: A New Checklist.,” The Scientific World Journal (2014), p. 434326. (https://doi.org/http://dx.doi.org/10.1155/2014/434326).
Gulati, A., and Dubey, S. K. 2012. “Critical Analysis on Usability Evaluation Techniques,” International Journal of Engineering Science and Technology (IJEST) (4:3), pp. 990–997.
Gupta, S. 2015. “A Comparative Study of Usability Evaluation Methods,” International Journal of Computer Trends and Technology (22:3), pp. 103–106. (https://doi.org/10.14445/22312803/ijctt-v22p121).
Hermawan, M. A., Hidayat, N., and Setiawan, B. D. 2017. “Sistem Optimasi Rute Tempat Wisata Kuliner Di Malang Menggunakan Algoritma Bee Colony,” Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer (1:3), pp. 215–223.
Hinderks, A., Schrepp, M., and Thomaschewski, J. 2018. “A Benchmark for the Short Version of the User Experience Questionnaire,” WEBIST 2018 - Proceedings of the 14th International Conference on Web Information Systems and Technologies (Webist), pp. 373–377. (https://doi.org/10.5220/0007188303730377).
Hussain, A., and Mkpojiogu, E. O. C. 2016. “Usability Evaluation Techniques in Mobile Commerce Applications: A Systematic Review,” AIP Conference Proceedings (1761). (https://doi.org/10.1063/1.4960889).
Khajouei, R., Zahiri Esfahani, M., and Jahani, Y. 2017. “Comparison of Heuristic and Cognitive Walkthrough Usability Evaluation Methods for Evaluating Health Information Systems,” Journal of the American Medical Informatics Association (24:e1), pp. e55–e60. (https://doi.org/10.1093/jamia/ocw100).
Mahatody, T., Sagar, M., and Kolski, C. 2010. “State of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions,” International Journal of Human-Computer Interaction (26:8), pp. 741–785. (https://doi.org/10.1080/10447311003781409).
Martins, A. I., Rosa, A. F., Queirós, A., Silva, A., and Rocha, N. P. 2015. “European Portuguese Validation of the System Usability Scale (SUS),” Procedia Computer Science (67:Dsai), Elsevier Masson SAS, pp. 293–300. (https://doi.org/10.1016/j.procs.2015.09.273).
Parne, S. R. 2010. “Android Application of Restaurant Finder,” Kansas State University.
Rahadiasta, R. I., Wijoyo, S. H., and Az-Zahra, H. M. 2019. “Evaluasi User Experience Pada Game FORTNITE MOBILE Menggunakan Metode Enhanced Cognitive Walkthrough,” Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer (3:9), pp. 9114–9123.
Salunkhe, P., and Singh, N. 2019. “ZOMATO – BUSINESS MODEL AND USE OF M-COMMERCE,” Journal of the Gujarat Research Society (21:14), pp. 243–254.
Satapathy, S. C., Udgata, S. K., and Biswal, B. N. 2014. “Proceedings of the International Conference on Frontiers of Intelligent Computing: Theory and Applications (FICTA) 2013,” Advances in Intelligent Systems and Computing (247), pp. 535–543. (https://doi.org/10.1007/978-3-319-02931-3).
Scholtes, M., Noll, K., Shrabi, K., and Gross, V. 2020. “Comparison of Formative Evaluation Methods in the Usability Process on the Example of a Medical App,” in Proceedings of the 14th Health Informatics Meets Digittal Health Conference, G. Schreier, D. Hayn, and A. Eggerth (eds.), Amsterdam: IOS Press, pp. 101–107. (https://doi.org/doi:10.3233/SHTI200081).
Schrepp, M. 2019. “User Experience Questionnaire Handbook.” (https://www.ueq-online.org/Material/Handbook.pdf).
Schrepp, M., Hinderks, A., and Thomaschewski, J. 2017. “Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S),” International Journal of Interactive Multimedia and Artificial Intelligence (4:6), p. 103. (https://doi.org/10.9781/ijimai.2017.09.001).
Sharfina, Z., and Santoso, H. B. 2017. “An Indonesian Adaptation of the System Usability Scale (SUS),” in 2016 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2016, pp. 145–148. (https://doi.org/10.1109/ICACSIS.2016.7872776).
Sharma, K., and Abdul Waheed, K. 2018. “Consumption of Online Food App Services : An Exploratory Study among College Students in Dubai,” Middle East Journal of Business (13:4), pp. 4–11. (https://doi.org/10.5742/mejb.2018.93500).
Stone, M. J., Migacz, S., and Wolf, E. 2019. “Beyond the Journey: The Lasting Impact of Culinary Tourism Activities,” Current Issues in Tourism (22:2), Taylor & Francis, pp. 147–152. (https://doi.org/10.1080/13683500.2018.1427705).
Suciyono, N., Anwar, D. S., and Setyawan, E. 2019. “Pencarian Wisata Kuliner Terdekat Dengan Menggunakan Metode LBS ( Location Based Service ) Berbasis Web Mobile Di Kota Tasikmalaya,” Jurnal Voice of Informatics (8:1), pp. 67–76.
Ulinuha, H. R., Utami, E., and Sunyoto, A. 2020. “Evaluasi User Experience Pada Game Pes 2020 Menggunakan Metode Cognitive Walkthrough,” Respati (15:2), pp. 45–52.
Unrau, R., and Kray, C. 2019. “Usability Evaluation for Geographic Information Systems: A Systematic Literature Review,” International Journal of Geographical Information Science (33:4), Taylor & Francis, pp. 645–665. (https://doi.org/10.1080/13658816.2018.1554813).
Published
2021-10-25
How to Cite
Putri Ambarwati, & Metty Mustikasari. (2021). Usability Evaluation of the Restaurant Finder Application Using Inspection and Inquiry Methods. Jurnal Sistem Informasi, 17(2), 1-17. https://doi.org/10.21609/jsi.v17i2.1049
Section
Articles
Copyright (c) 2021 Jurnal Sistem Informasi
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
