Exploring Faculty Members’ Experiences with Virtual Classroom Platforms and Their Perceived Usability during the COVID-19

Year 2024, Volume: 11 Issue: 4, 524 - 542

Zafer Kadırhan , Mustafa Şat , Yunus Alkış

https://doi.org/10.30900/kafkasegt.1483268

Abstract

This two-phase mixed-method study examined faculty experiences with Virtual Communication Platforms (VCPs) and their usability in distance education during the COVID-19 epidemic. A stratified random sample of 913 faculty members from 167 universities was selected to participate in an online questionnaire that included the System Usability Scale, demographic information, and open-ended questions. Twenty-five of the faculty members who had completed the online questionnaire were then interviewed in semi-structured interviews. The quantitative analysis results indicate that Zoom was the most favored platform, obtaining a ‘Good’ usability score together with Google Meet and Adobe Connect. In contrast, Perculus and Microsoft Teams were evaluated as having ‘Poor’ usability. Results also revealed the significant effect of gender on Perculus, distance education experience on Zoom, and age and academic status on Zoom and Google Meet usability perceptions. Furthermore, the qualitative analysis results revealed usability challenges (e.g., technical challenges, functionality issues, usability concerns), positive aspects (e.g., usability and effectiveness, support and issue resolution, performance and accessibility), and suggestions for improvement (e.g., instruction and support, exploration and optimization, format and assessment enhancement). The study offers valuable insights for institutions to make informed decisions about adopting VCP, investing in targeted training programs, and ultimately fostering a more effective and inclusive distance education environment.

Keywords

Virtual Classroom Platform (VCP), Synchronous Distance Education, COVID-19, System Usability, Faculty Members

References

• Alajmi, M. A., & Said Ali, M. (2022). Video-conference Platforms: Understanding the Antecedents and Consequences of Participating in or Attending Virtual Conferences in Developing Countries. International Journal of Human–Computer Interaction, 38(13), 1195–1211. https://doi.org/10.1080/10447318.2021.1988237
• Alanazi, A. A., Frey, B. B., Niileksela, C., Lee, S. W., Nong, A., & Alharbi, F. (2020). The Role of Task Value and Technology Satisfaction in Student Performance in Graduate-Level Online Courses. TechTrends, 64(6), 922–930. https://doi.org/10.1007/s11528-020-00501-8
• Alhadreti, O. (2021). Assessing Academics’ Perceptions of Blackboard Usability Using SUS and CSUQ: A Case Study during the COVID-19 Pandemic. International Journal of Human–Computer Interaction, 37(11), 1003–1015. https://doi.org/10.1080/10447318.2020.1861766
• Alhusban, M. I., Sarhan, N., Khatatbeh, I. N., & Al Shbail, M. O. (2024). Exploring how quality dimensions enhance videoconferencing platform benefits from an information systems success perspective. Discover Sustainability, 5(1), 59. https://doi.org/10.1007/s43621-024-00215-4
• Al-Qora’n, L., Salem, O. A. S., & Gordon, N. (2022). Heuristic Evaluation of Microsoft Teams as an Online Teaching Platform: An Educators’ Perspective. Computers, 11(12), 175. https://doi.org/10.3390/computers11120175
• Amin Rifat, M. Al, Md. Towhidul Alam, K., & Hassan Onik, Md. M. (2022). Privacy, Security and Usability Comparison of Online Learning Platforms in Developing Countries: A Study on Bangladeshi Universities. 2022 4th International Conference on Sustainable Technologies for Industry 4.0 (STI), 1–6. https://doi.org/10.1109/STI56238.2022.10103287
• Bailey, D. (2022). Interactivity during Covid-19: mediation of learner interactions on social presence and expected learning outcome within videoconference EFL courses. Journal of Computers in Education, 9(2), 291–313. https://doi.org/10.1007/s40692-021-00204-w
• Bangor, A., Kortum, B., & Miller, J. (2009). Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. Journal of User Experience, 4(3), 114–123.
• Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776
• Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
• Brooke, J. (2013). SUS: A Retrospective. Journal of Usability Studies, 8(2), 29–40.
• Çakıroğlu, Ü., Aydın, M., Bahadır Kurtoğlu, Y., & Cebeci, Ü. (2023). How Instructors’ TPACK Developed During Emergency Remote Teaching: Evidence From Instructors in Faculties of Education. The International Review of Research in Open and Distributed Learning, 24(2), 162–188. https://doi.org/10.19173/irrodl.v24i2.7177
• Chang, H., Varvello, M., Hao, F., & Mukherjee, S. (2022). A Tale of Three Videoconferencing Applications: Zoom, Webex, and Meet. IEEE/ACM Transactions on Networking, 30(5), 2343–2358. https://doi.org/10.1109/TNET.2022.3171467
• Chen, J., Xu, J., Tang, T., & Chen, R. (2017). WebIntera-classroom: an interaction-aware virtual learning environment for augmenting learning interactions. Interactive Learning Environments, 25(6), 792–807. https://doi.org/10.1080/10494820.2016.1188829
• Correia, A.-P., Liu, C., & Xu, F. (2020). Evaluating videoconferencing systems for the quality of the educational experience. Distance Education, 41(4), 429–452. https://doi.org/10.1080/01587919.2020.1821607
• Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed.). Pearson Education Inc.
• Di Giacomo, P., & Di Paolo, C. (2021). COVID-19 and dental distance-based education: students’ perceptions in an Italian University. BMC Medical Education, 21(1), 414. https://doi.org/10.1186/s12909-021-02840-3
• Granić, A., & Ćukušić, M. (2011). Usability testing and expert inspections complemented by educational evaluation: A case study of an e-learning platform. Journal of Educational Technology & Society, 14(2), 107–123.
• Grynyuk, S., Kovtun, O., Sultanova, L., Zheludenko, M., Zasluzhena, A., & Zaytseva, I. (2022). Distance Learning During the COVID-19 Pandemic: The Experience of Ukraine’s Higher Education System. Electronic Journal of E-Learning, 20(3), pp242-256. https://doi.org/10.34190/ejel.20.3.2198
• Islam, Md. K., Sarker, Md. F. H., & Islam, M. S. (2022). Promoting student-centred blended learning in higher education: A model. E-Learning and Digital Media, 19(1), 36–54. https://doi.org/10.1177/20427530211027721
• Kadirhan, Z., Gul, A., & Battal, A. (2015). System Usability Scale: A Validity and Reliability Study. Educational Sciences and Practive, 14(28), 149–167.
• Karagöz, N., & Ağadayı, E. (2020). Behaviors and problems of a medical school students’ related to distance education in pandemic medical education in the pandemic process. The Journal of Turkish Family Physician, 11(4), 149–158. https://doi.org/10.15511/tjtfp.20.00449
• Keegan, D. J. (1980). On defining distance education. Distance Education, 1(1), 13–36. https://doi.org/10.1080/0158791800010102
• Khan, R. A., Atta, K., Sajjad, M., & Jawaid, M. (2022). Twelve tips to enhance student engagement in synchronous online teaching and learning. Medical Teacher, 44(6), 601–606. https://doi.org/10.1080/0142159X.2021.1912310
• Labrie, A., Mok, T., Tang, A., Lui, M., Oehlberg, L., & Poretski, L. (2022). Toward Video-Conferencing Tools for Hands-On Activities in Online Teaching. Proceedings of the ACM on Human-Computer Interaction, 6(GROUP), 1–22. https://doi.org/10.1145/3492829
• Leporini, B., Buzzi, M., & Hersh, M. (2021). Distance meetings during the covid-19 pandemic. Proceedings of the 18th International Web for All Conference, 1–10. https://doi.org/10.1145/3430263.3452433
• Lewis, L. R., & Sauro, J. (2018). Item Benchmarks for the System Usability Scale. Journal of User Experience, 13(3), 158–167.
• Li, C., & Lalani, F. (2020). The COVID-19 pandemic has changed education forever. This is how. World Economic Forum. https://www.weforum.org/agenda/2020/04/coronavirus-education-global-covid19-online-digital-learning/
• Lytvyn, V., Akimova, O., Kuznetsova, H., Zenchenko, T., Stepanenko, O., & Koreneva, I. (2021). use of synchronous and asynchronous teaching methods in pedagogical education in COVID-19 terms. International Journal of Health Sciences, 5(3), 617–629. https://doi.org/10.53730/ijhs.v5n3.2681
• Markel, M. (1999). Distance Education and the Myth of the New Pedagogy. Journal of Business and Technical Communication, 13(2), 208–222. https://doi.org/10.1177/1050651999013002005
• Mastrisiswadi, H., Rahmawati, B. D., & Wibowo, A. W. A. (2023). User preferences for video conferencing using the analytical hierarchical process (AHP). 030005. https://doi.org/10.1063/5.0164132
• McDaniels, M., Pfund, C., & Barnicle, K. (2016). Creating Dynamic Learning Communities in Synchronous Online Courses: One Approach from the Center for the Integration of Research, Teaching and Learning (CIRTL). Online Learning, 20(1). https://doi.org/10.24059/olj.v20i1.518
• Mesran, M., Nasution, S. D., Suginam, S., Afriany, J., & Ramdhan, W. (2021). Optimalisasi Penggunaan Software Zoom dan Google Meet Dalam Meningkatkan Efektifitas Pembelajaran Daring. Journal of Social Responsibility Projects by Higher Education Forum, 2(2), 94–97. https://doi.org/10.47065/jrespro.v2i2.987
• Moore, M. G. (2000). Editorial: Technology‐driven change: Where does it leave the faculty? American Journal of Distance Education, 14(1), 1–6. https://doi.org/10.1080/08923640009527041
• Moore, M. G., & Kearsley, G. (2011). Distance Education: A Systems View of Online Learning (3rd Ed.). Wadsworth Publishing.
• Mutea, N., & Cullen, D. (2012). Kenya and distance education: A model to advance graduate nursing. International Journal of Nursing Practice, 18(4), 417–422. https://doi.org/10.1111/j.1440-172X.2012.02043.x
• Nielsen, J. (1993). Usability Engineering. Academic Press.
• Nieuwoudt, J. E. (2020). Investigating synchronous and asynchronous class attendance as predictors of academic success in online education. Australasian Journal of Educational Technology, 15–25. https://doi.org/10.14742/ajet.5137
• Oiwake, K., Komiya, K., Akasaki, H., & Nakajima, T. (2018). VR Classroom: Enhancing Learning Experience with Virtual Class Rooms. 2018 Eleventh International Conference on Mobile Computing and Ubiquitous Network (ICMU), 1–6. https://doi.org/10.23919/ICMU.2018.8653607
• Pal, D., & Vanijja, V. (2020). Perceived usability evaluation of Microsoft Teams as an online learning platform during COVID-19 using system usability scale and technology acceptance model in India. Children and Youth Services Review, 119, 105535. https://doi.org/10.1016/j.childyouth.2020.105535
• Poolsawas, B., & Chotikakamthorn, N. (2023). Using Mozilla Hubs for Online Teaching: A Case Study of an Innovation Design Method Course. 7–12. https://doi.org/10.54808/IMSCI2023.01.7
• Qayyum, A., & Zawacki-Richter, O. (2018). Open and distance education in a digital age. In A. Qayyum & O. Zawacki-Richter (Eds.), Open and distance education in Australia, Europe and the Americas (pp. 1-7). Springer.
• Rehman, S. ur, & Khan, M. U. (2016). Security and Reliability Requirements for a Virtual Classroom. Procedia Computer Science, 94, 447–452. https://doi.org/10.1016/j.procs.2016.08.069
• Rizwan, M., & Iftikhar, I. (2019). Factors Affecting Student Satisfaction in Distance Learning: A Case Study. The Journal of Educational Paradigms, 1(2), 50–56. https://doi.org/10.47609/0102012019
• Schulte, M. (2011). The Foundations of Technology Distance Education: A Review of the Literature to 2001. The Journal of Continuing Higher Education, 59(1), 34–44. https://doi.org/10.1080/07377363.2011.544981
• Shoepe, T. C., McManus, J. F., August, S. E., Mattos, N. L., Vollucci, T. C., & Sparks, P. R. (2020). Instructor Prompts and Student Engagement in Synchronous Online Nutrition Classes. American Journal of Distance Education, 34(3), 194–210. https://doi.org/10.1080/08923647.2020.1726166
• Stewart, A. R., Harlow, D. B., & DeBacco, K. (2011). Students’ experience of synchronous learning in distributed environments. Distance Education, 32(3), 357–381. https://doi.org/10.1080/01587919.2011.610289
• UNESCO. (2023). UNESCO’s education response to COVID-19. https://www.unesco.org/en/covid-19/education-response/initiatives
• Van Nuland, S. E., Eagleson, R., & Rogers, K. A. (2017). Educational software usability: Artifact or Design? Anatomical Sciences Education, 10(2), 190–199. https://doi.org/10.1002/ase.1636
• Vital-López, L., García-García, R., Rodríguez-Reséndíz, J., Paredes-García, W., Zamora-Antuñano, M., Oluyomi-Elufisan, T., Rodríguez Reséndiz, H., Álvarez Sánchez, A., & Cruz-Pérez, M. (2022). The Impacts of COVID-19 on Technological and Polytechnic University Teachers. Sustainability, 14(8), 4593. https://doi.org/10.3390/su14084593
• Zou, C., Zhao, W., & Siau, K. (2020). COVID-19 Pandemic: A Usability Study on Platforms to Support eLearning. In C. Stephanidis, M. Antona, & S. Ntoa (Eds.), HCI International 2020 – Late Breaking Posters. HCII 2020. Communications in Computer and Information Science (Vol. 1294, pp. 333–340). Springer. https://doi.org/10.1007/978-3-030-60703-6_43