STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS

Year 2023, Volume: 24 Issue: 4, 276 - 301, 01.10.2023

Betul Tonbuloglu

https://doi.org/10.17718/tojde.1184218

Abstract

This study aimed to reveal the trend of research on e-assessment in the field of educational sciences through scientific mapping and bibliometric analyses. For this purpose, the numerical distribution of research on e-assessment, citation analysis, research themes and the change of trend topics were examined. The publications to be examined were selected from WoS database according to PRISMA model, and 911 studies were included in the analysis. VOSviewer, Biblioshiny, Smart Bibliometrics and Leximancer software were used in data analysis. Apparently, there has been a significant increase in the number of research since 2005, and publications have been mostly produced in form of articles and papers. The most cited and the most productive countries are the USA, the United Kingdom and Australia, while the most cited journals are Assessment & Evaluation in Higher Education and British Journal of Educational Technology. An analysis of the keyword map revealed that the themes of technology and motivation, blended learning and collaboration, interaction and innovative approaches, validity and reliability, higher education, quality, basic disciplines and Covid-19 were frequently emphasized in the studies on e-assessment. An analysis of trend topics by years showed that, between 2010 and 2021, the trend topic distribution changed to include topics such as Covid-19, academic integrity, engagement, cheating, case study, and higher education. All these findings reveal that e-evaluation activities have displayed a development and transformation over time with the effect of developing technology, the pandemic, the spread of e-learning, the expansion of communication opportunities and many other factors.

Keywords

E-assessment, online assessment, online evaluation, e-learning, bibliometric analysis

References

• Akiri, E., Tor, H. M., & Dori, Y. J. (2021). Teaching and Assessment Methods: STEM Teachers' Perceptions and Implementation. Eurasia Journal of Mathematics, Science and Technology Education, 17(6). https://eric.ed.gov/?id=EJ1302499
• Akyol, Z., Garrison, D. R., & Ozden, M. Y. (2009). Online and blended communities of inquiry: Exploring the developmental and perceptional differences. The International Review of Research in Open and Distributed Learning, 10(6), 65-83. https://doi.org/10.19173/irrodl.v10i6.765
• Balstad, M. T., Berg, T. (2020). A long-term bibliometric analysis of journals influencing management accounting and control research. Journal of Management Control, 30, 357-380. https://doi.org/10.1007/s00187-019-00287-8
• Bradford, S. C. (1934). Sources of information on specific subjects. Engineering, 137, 85-86.
• Broadus, R. N. (1987). Toward a definition of “bibliometrics”. Scientometrics, 12(5), 373-379. https://link.springer.com/article/10.1007/BF02016680
• Cong, X., Zhang, Y., Xu, H., Liu, L. M., Zheng, M., Xiang, R. L., ... & Wu, L. L. (2020). The effectiveness of formative assessment in pathophysiology education from students’ perspective: a questionnaire study. Advances in Physiology Education, 44(4), 726-733. https://doi.org/10.1152/advan.00067.2020
• Conn, C., & Norris, J. (2005). Investigating strategies for increasing student response rates to online delivered course evaluations. 2003 Annual Proceedings-Anaheim: 77- 85. https://files.eric.ed.gov/fulltext/ED496305.pdf#page=87
• Crisp, V., & Ward, C. (2008). The development of a formative scenario-based computer assisted assessment tool in psychology for teachers: The PePCAA project. Computers & Education, 50(4), 1509-1526. https://doi.org/10.1016/j.compedu.2007.02.004
• Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research, 133, 285-296. https://doi.org/10.1016/j.jbusres.2021.04.070
• Flavin, M. (2021). A Disruptive Innovation perspective on students’ opinions of online assessment. Research in Learning Technology, 29. https://journal.alt.ac.uk/index.php/rlt/article/view/2611/2887
• Fructuoso, I. N., Roldán, A. E. G., Hidalgo, E. H., Roca, R., & Besora, D. B. (2018). Enhancing the quality of online assessment with the support of an e-authentication system. Edulearn 18. 10th International Conference on Education and New Learning Technology:(Palma, 2nd-4th of July, 2018). Conference proceedings (pp. 1893-1903). IATED Academy.
• Gamage, S. H., Ayres, J. R., & Behrend, M. B. (2022). A systematic review on trends in using Moodle for teaching and learning. International Journal of STEM Education, 9(1), 1-24. https://doi.org/10.1186/s40594-021-00323-x
• Garfield, E. (1980). Is information retrieval in the arts and humanities inherently different from that in science? The effect that ISI®'s citation index for the arts and humanities is expected to have on future scholarship. The Library Quarterly, 50(1), 40-57. https://doi.org/10.1086/629874
• Ghergulescu, I., & Muntean, C. H. (2014). A novel sensor-based methodology for learner's motivation analysis in game-based learning. Interacting with Computers, 26(4), 305-320. https://ieeexplore.ieee.org/abstract/document/8154837
• Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers & education, 57(4), 2333-2351. https://doi.org/10.1016/j.compedu.2011.06.004
• Joint Information Systems Committee (JISC). (2007). Effective practice with e-assessment: An overview of technologies, policies and practice in further and higher education. http://www.jisc.ac.uk/media/documents/themes/elearning/effpraceassess.pdf
• Jordan, S. (2013). E-assessment: Past, present and future. New Directions in the Teaching of Physical Sciences, 9, 87–106. https://doi.org/10.29311/ndtps.v0i9.504
• Karim, N. A., & Shukur, Z. (2015). Review of user authentication methods in online examination. Asian Journal of Information Technology, 14(5), 166-175.
• Khan, M. A., Pattnaik, D., Ashraf, R., Ali, I., Kumar, S., & Donthu, N. (2021). Value of special issues in the journal of business research: A bibliometric analysis. Journal of business research, 125, 295-313. https://doi.org/10.1016/j.jbusres.2020.12.015
• Kocdar, S., Karadeniz, A., Peytcheva-Forsyth, R., & Stoeva, V. (2018). Cheating and plagiarism in e-assessment: Students' perspectives. Open Praxis, 10(3), 221-235.
• MacCoun, R. J. (1998). Biases in the interpretation and use of research results. Annual review of psychology, 49(1), 259-287. https://bit.ly/3rosoin
• Massimo, A., & Cuccurullo, C. (2021). Biblioshiny: the shiny interface for bibliometrix. https://bibliometrix.org/About.html
• Mattsson, P., Sundberg, C.J., Laget, P. (2011). Is correspondence reflected in the author position? A bibliometric study of the relation between corresponding author and byline position. Scientometrics, 87, 99–105. https://doi.org/10.1007/s11192-010-0310-9
• Mellar, H., Peytcheva-Forsyth, R., Kocdar, S., Karadeniz, A., & Yovkova, B. (2018). Addressing cheating in e-assessment using student authentication and authorship checking systems: teachers’ perspectives. International Journal for Educational Integrity, 14(1), 1-21. https://doi.org/10.1007/s40979-018-0025-x
• Mishra, S., Sahoo, S., & Pandey, S. (2021). Research trends in online distance learning during the COVID-19 pandemic. Distance Education, 1-26. https://doi.org/10.1080/01587919.2021.1986373
• Moodle Project, (2022). Moodle statistics. https://stats.moodle.org/ . Accessed 6 Sept 2022.
• Na, S. J., Ji, Y. G., & Lee, D. H. (2021). Application of Bloom’s taxonomy to formative assessment in real-time online classes in Korea. Korean Journal of Medical Education, 33(3), 191. https://doi.org/10.3946/kjme.2021.199
• Nicol, D. J., & Macfarlane‐Dick, D. (2006). Formative assessment and self‐regulated learning: A model and seven principles of good feedback practice. Studies in higher education, 31(2), 199-218. https://doi.org/10.1080/03075070600572090
• Nicol, D. (2007). Laying a foundation for lifelong learning: Case studies of e-assessment in large first year classes. British Journal of Educational Technology, 38(4): 668–78. https://doi.org/10.1111/j.1467-8535.2006.00657.x
• Nikou, S. A., & Economides, A. A. (2018). Mobile-based assessment: A literature review of publications in major referred journals from 2009 to 2018. Computers & Education, 125, 101–119. https://doi.org/10.1016/j.compedu.2018.06.00
• Okada, A., Noguera, I., Alexieva, L., Rozeva, A., Kocdar, S., Brouns, F., ... & Guerrero‐Roldán, A. E. (2019). Pedagogical approaches for e‐assessment with authentication and authorship verification in Higher Education. British Journal of Educational Technology, 50(6), 3264-3282. https://doi.org/10.1111/bjet.12733
• Page, M.J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., Mulrow, C.D., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S.E., Chou, R., Glanville, J., Grimshaw, J., Hróbjartsson, A., Lalu, M.M., Li, T., Loder, E., Mayo-Wilson, E., McDonald, S., … Moher, D. (2020). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. https://doi.org/10.31222/osf.io/v7gm2
• Pessin, V. Z., Yamane, L. H., & Siman, R. R. (2022). Smart bibliometrics: an integrated method of science mapping and bibliometric analysis. Scientometrics, 1-24. https://link.springer.com/article/10.1007/s11192-022-04406-6
• Peytcheva-Forsyth, R., Aleksieva, L., & Yovkova, B. (2018). The impact of prior experience of e-learning and e-assessment on students’ and teachers’ approaches to the use of a student authentication and authorship checking system. EDULEARN18 Proceedings, 2311-2321. https://bit.ly/3OCGK80
• Rialp, A., Merigó, J. M., Cancino, C. A., & Urbano, D. (2019). Twenty-five years (1992–2016) of the international business review: a bibliometric overview. International Business Review, 28(6), 101587. https://doi.org/10.1016/j.ibusrev.2019.101587
• Rolim, C., & Isaias, P. (2019). Examining the use of e-assessment in higher education: Teachers and students' viewpoints. British Journal of Educational Technology, 50(4), 1785–1800. https://doi.org/10.1111/bjet.12669
• Singh, J. (2015). Moodle Statistics – Moodle now has more than 78 million users all over the World. . Retrieved 6 Sept 2022 from https://www.lmspulse.com/2015/moodle-statistics-moodle-now-has-more-than-78-million-users-all-over-the-world-moodleworld-moodle/
• Smith, A. E., & Humphreys, M. S. (2006). Evaluation of unsupervised semantic mapping of natural language with Leximancer concept mapping. Behavior research methods, 38(2), 262-279. https://doi.org/10.3758/BF03192778
• Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of business research, 104, 333-339. https://doi.org/10.1016/j.jbusres.2019.07.039
• Stödberg, U. (2012). A research review of e-assessment. Assessment & Evaluation in Higher Education, 37(5), 591-604. https://doi.org/10.1080/02602938.2011.557496
• St‐Onge, C., Ouellet, K., Lakhal, S., Dubé, T., & Marceau, M. (2022). COVID‐19 as the tipping point for integrating e‐assessment in higher education practices. British Journal of Educational Technology, 53(2), 349-366. https://doi.org/10.1111/bjet.13169
• Sudakova, N. E., Savina, T. N., Masalimova, A. R., Mikhaylovsky, M. N., Karandeeva, L. G., & Zhdanov, S. P. (2022). Online Formative Assessment in Higher Education: Bibliometric Analysis. Education Sciences, 12(3), 209. https://doi.org/10.3390/educsci12030209
• Thomson, K. & Falchikov, N. (1998). ‘Full on until the sun comes out’: The effects of assessment on student approaches to studying. Assessment & Evaluation in Higher Education, 23(4): 379–390. https://doi.org/10.1080/0260293980230405
• Tight, M. (2019). Globalization and internationalization as frameworks for higher education research. Research Papers in Education. 36(1), 52-74. https://doi.org/10.1080/02671522.2019.1633560
• Van der Pol, J., Van den Berg, B. A. M., Admiraal, W. F., & Simons, P. R. J. (2008). The nature, reception, and use of online peer feedback in higher education. Computers & Education, 51(4), 1804-1817. https://doi.org/10.1016/j.compedu.2008.06.001
• Van Eck, N. J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523–538. https://doi.org/10.1007/s11192-009-0146-3
• Wang, T. H. (2008). Web-based quiz-game-like formative assessment: Development and evaluation. Computers & Education, 51(3), 1247-1263. https://doi.org/10.1016/j.compedu.2007.11.011
• Whitelock, D., Thorpe, M., & Galley, R. (2015). Student workload: A case study of its significance, evaluation and management at the Open University. Distance Education, 36(2), 161–176. https://doi.org/10.1080/01587919.2015.10550
• Xie, L.; Chen, Z.; Wang, H.; Zheng, C.; Jiang, J. (2020). Bibliometric and Visualized Analysis of Scientific Publications on Atlantoaxial Spine Surgery Based on Web of Science and VOSviewer. World Neurosurg, 137, 435–442. https://doi.org/10.1016/j.wneu.2020.01.171
• Zawacki-Richter, O., & Latchem, C. (2018). Exploring four decades of research in Computers & Education. Computers & Education, 122, 136-152. https://doi.org/10.1016/j.compedu.2018.04.001