Review
BibTex RIS Cite

NİTEL ARAŞTIRMALARDA ÇEVRİMİÇİ ODAK GRUP GÖRÜŞMELERİ

Year 2024, Volume: 24 Issue: 1, 55 - 72, 31.07.2024
https://doi.org/10.54961/uobild.1489908

Abstract

Nitel araştırmalarda yaygın bir şekilde görüşme tekniği aracılığıyla veriler oluşturulmaktadır. Görüşme türlerinden birisi olan odak grup görüşmelerinde gruptaki üyeler, kendi duygu, düşünce ve deneyimlerini ifade ederken gruptaki diğer üyelerin deneyimlerini de öğrenebilmektedirler. Böylece odak grup görüşmelerinde kişilerarası etkileşime dayalı olarak veriler oluşturulmaktadır. Görüşmeler genellikle yüz yüze gerçekleştirilse de bu durum her zaman mümkün olmamakta ve araştırmacılar giderek daha fazla çevrimiçi odak grup görüşme yönteminden yararlanmaktadır. Çevrimiçi odak grup görüşmeleri yüz yüze odak grup görüşmelerinden ayrılmaktadır. Çevrimiçi odak grup görüşme yönteminin nitel araştırmalarda giderek daha fazla kullanılmaya başlanması bu tekniğin avantaj ve dezavantajlarını da gündeme getirmektedir. Çevrimiçi odak grup görüşme yönteminin sağladığı avantajların yanı sıra birtakım dezavantajları da bulunmaktadır. Bu doğrultuda, çevrimiçi odak grup görüşmeleri sırasında karşı karşıya kalınabilecek sorunlar ile baş edebilmek için nitel araştırmacıların yöntem, uygulama ve etik konuları gözeterek veri oluşturması gerekmektedir.

References

  • Abrams, K. M., Wang, Z., Song, Y. S. & Galindo-Gonzalez, S. (2015). Data richness trade-offs between face-to-face, online audiovisual, and online text-only focus groups. Social Science Computer Review, 33, 80-96. doi:10.1177/0894439313519733
  • Burton, L. J. & Bruening, J. E. (2003). Technology and method intersect in the online focus group. Quest, 55, 315-327. doi:10.1080/00336297.2003.10491807
  • Büyüköztürk, Ş., Kılıç-Çakmak, E., Akgün, Ö. E., Karadeniz, Ş. & Demirel, F. (2021). Eğitimde bilimsel araştırma yöntemleri (31. Baskı). Ankara: Pegem Akademi.
  • Chong, E., Alayli-Goebbels, A., Webel-Edgar, L., Muir, S. & Manson, H. (2015). Advancing telephone focus groups method through the use of Webinar: Methodological reflections on evaluating ontario, Canada’s healthy babies healthy children program. Global Qualitative Nursing Research, 1–8. doi:10.1177/2333393615607840
  • Cibangu, S. K. (2013). A memo of qualitative research for information science: Toward theory construction. Journal of Documentation, 69, 194-213. doi:10.1108/00220411311300048
  • Çokluk, Ö., Yılmaz, K. & Oğuz, E. (2011). Nitel bir görüşme yöntemi: Odak grup görüşmesi. Kuramsal Eğitimbilim, 4, 95-107.
  • Daniels, N., Gillen, P., Casson, K. & Wilson, I. (2019). STEER: Factors to consider when designing online focus groups using audiovisual technology in health research. International Journal of Qualitative Methods, 18, 1-11. doi:10.1177/1609406919885786
  • Deakin, H. & Wakefield, K. (2014). Skype interviewing: Reflections of two PhD researchers. Qualitative Research, 14, 603–616. doi:10.1177/1468794113488126
  • Dos-Santos-Marques, I. C., Theiss, L. M., Johnson, C. Y., McLin, E., Ruf, B. A., Vickers, S. M., … Chu, D. I. (2021). Implementation of virtual focus groups for qualitative data collection in a global pandemic. American Journal of Surgery, 221, 918-922. doi:10.1016%2Fj.amjsurg.2020.10.009
  • Edwards, R. & Holland, J. (2020). Reviewing challenges and the future for qualitative interviewing. International Journal of Social Research Methodology, 23, 581-592.doi:10.1080/13645579.2020.1766767
  • Ergül, Y. (2020). Halkla İlişkiler araştırmalarında çevrimiçi odak grup görüşme tekniği üzerine bir inceleme. 4. Yeni Zamanlar ve Halkla İlişkiler Sempozyumu, 114-122.
  • Flick, U. (2022). Handbook of qualitative research design. SAGE Publications.
  • Freeman, T. (2006). ‘Best practice’ in focus group research: Making sense of different view. Methodological Issues in Nursing Research, 56, 491-497. doi:10.1111/j.1365-2648.2006.04043.x
  • Frost, N. (2021). Qualitative research methods in psychology: Combining core approachies (2nd Edition). McGraw-Hill Education UK.
  • Gibson, S. & Sullivan, C. (2018). A changing culture? Qualitative methods teaching in U.K. psychology. Qualitative Psychology, 5, 197–206. doi:10.1037/qup0000100
  • Glesne, C. (2020). Nitel araştırmaya giriş. Ali Ersoy ve Pelin Yalçınoğlu (Çev.). Ankara: Anı.
  • Gratton, M. F. & O’Donnell, S. (2011). Communication technologies for focus groups with remote communities: A case study of research with First Nations in Canada. Qualitative Research, 11, 159–175. doi:10.1177/1468794110394068
  • Greenspan, S. B., Gordon, K.L., Whitcomb, S. A. & Lauterbach, A. A. (2021). Use of video conferencing to facilitate focus grouyps for qualitative data collection. American Journal of Qualitative Research, 5, 85-93. doi.10.29333/ajqr/10813
  • Gülcan, C. (2021). Nitel bir veri toplama aracı: Odak (focus) grup tekniğinin uygulanışı ve geçerliliği üzerine bir çalışma. Mersin Üniversitesi Sosyal Bilimler Enstitüsü e-Dergisi, 4, 94-109.
  • Hallam, K. F. (2021). Moving on from trials and errors: A discussion on the use of a forum as an online focus group in qualitative research. International Journal of Social Research Methodology, 25, 429-439. doi:10.1080/13645579.2021.1888402
  • Jackson, A. Y. & Mazzei, L. A. (2022). Thinking with theory in qualitative reserach (2nd Edition). London: Routledge.
  • Jarvelin, K. & Vakkari, P. (1993). The evolution of library and information science 1965-1985: A content analysis of journal articles. Information Processing & Management, 29, 129-144. doi:10.1016/0306-4573(93)90028-C
  • Karasar, N. (2020). Bilimsel irade algı çerçevesi ile araştırma yöntemi kavramlar, ilkeler ve teknikler (36. Baskı). Ankara: Nobel.
  • Kazak, A. E. (2018). Editorial: Journal article reporting standarts. American Psychologist, 73, 1-2. doi:10.1037/amp0000263
  • LaMarre, A. & Chamberlain, K. (2022). Innovating qualitative research methods: Proposals and possibilities. Methods in Psychology, 6. doi:10.1016/j.metip.2021.100083
  • Lichtman, M. (2023). Qualitative research in education (4th Edition). New York: Routledge.
  • Marks, L. D., Kelley, H. H. & Galbraith, Q. (2021). Explosion or much ado about little?: A quantitative examination of qualitative publications from 1995-2017. Qualitative Research in Psychology, 1-19. doi:10.1080/14780887.2021.1917740
  • Matthews, K. L., Baird, M. & Duchesne, G. (2018) Using online meeting software to facilitate geographically dispersed focus groups for health workforce research. Qualitative Health Research, 28, 1621–1628. doi:10.1177/1049732318782167
  • Maxwell, J. A. (2019). The value of qualitative inquiry for Public Policy. Qualitative Inquiry, 1-10. doi:10.1177/1077800419857093
  • Moore, T., Mckee, K. & McLoughlin, P. (2015). Online focus groups and qualitative research in the social sciences: Their merits and limitations in a study of housing and youth. People, Place and Policy, 9, 17-28. doi:10.3351/ppp.0009.0001.0002
  • Morse, J. M. (2015). Critical analysis of strategies for determining rigor in qualitative inquiry. Qualitative Health Research, 25, 1212–1222. doi:10.1177/1049732315588501
  • Murgado-Armenteros, E. M., Torres-Ruiz, F. J. & Vega-Zamora, M. (2012). Differences between online and face to face focus groups, viewed through two approaches. Journal of Theoretical and Applied Electronic Commerce Research, 7, 73–86.
  • Reisner, S. L., Randazzo, R. K., White-Hughto, J. M., Peitzmeier, S., DuBois, L. Z., Pardee, D. J., Marrow, E., … Potter, J. (2017) Sensitive health topics with underserved patient populations: Methodological considerations for online focus group discussions. Qualitative Health Research, 28, 1658–1673. doi:10.1177/1049732317705355
  • Rennie, D. L., Watson, K. & Monteiro, A. (2002). The rise of qualitative research in psychology. Canadian Psychology / Psychologie Canadienne, 43, 179–189. doi:10.1037/h0086914
  • Richard, B., Sivo, S. A., Orlowski, M., Ford, R. C., Murphy, J., Boote, D. N. & Witta, E. L. (2021). Qualitative research via focus groups: Will going online affect the diversity of your findings? Cornell Hospitality Quarterly, 62, 32–45. doi:10.1177/1938965520967769
  • Rubin, J. D., Bell, S. & McClelland, S. I. (2018). Graduate education in qualitative methods in U.S. psychology: Current trends and recommendations fort he future. Qualitative Research in Psychology, 15, 29-50. doi:10.1080/14780887.2017.1392668
  • Rupert, D. J., Poehlman, J. A., Hayes, J. J., Ray, S. E. &Moultrie, R. R. (2017). Virtual versus in-person focus groups: Comparison of costs, recruitment, and participant logistics. Journal of Medical Internet Research, 19, e80. doi:10.2196/jmir.6980
  • Saarjiarvi, M. & Bratt, E. L. (2021). When face-to-face interviews are not possible: Tips and tricks for video, telephone, online chat, and email interviews in qualitative research. Europeas Journal of Cardiovascular Nursing, 20, 392-396. doi:10.1093/eurjcn/zvab038
  • Santhosh, L. Rojas, J. C., Garcia, B., Thomashow, M. & Lyons, P. G. (2022). Zooming into focus groups: Strategies for qualitative research in the Era of Social Distancing. National Library of Medicine, 2, 176-184. doi:10.34197%2Fats-scholar.2020-0127PS
  • Savin-Baden, M. & Major, C. (2023). Qualitative research: The essential guide to theory and practice (1st Edition). London: Routledge.
  • Seyidoğlu, H. (2020). Bilimsel araştırma ve yazma el kitabı (12. Baskı). İstanbul: Güzem Can.
  • Schneider, S. J., Kerwin, J., Frechtling, J. & Vivari, B. A. (2002). Characteristics of the discussion in online and face-to-face focus groups. Social Science Computer Review, 20, 31-42. doi:10.1177/089443930202000104
  • Stickley, T. O’Caithain, A. & Homer, C. (2022). The value of qualitative methods to public health research, policy and practice. Perspectives in Public Health, 142, 237-240. doi:10.1177/17579139221083814
  • Synnot, A., Hill, S., Summers, M. & Taylor, M. (2014). Comparing face-to-face and online qualitative research with people with multiple sclerosis. Qualitative Health Research, 24, 431–438. doi:10.1177/1049732314523840
  • Tates, K., Zwaanswijk, M., Otten, R., Dulmen, S. V., Hoogerbrugg, P. M., Kamps, W. A. & Bensing, J. M. (2009). Online focus groups as a tool to collect data in hard-to-include populations: Examples from paediatric oncology. BMC Medical Research Methodology, 9, 1-8.
  • Turney, L. & Pocknee, C. (2005). Virtual focus groups: New frontiers in research. International Journal of Qualitative Methods, 4, 32-43. doi:10.1177/160940690500400203
  • Uslu-Ak, B. (2022). Sosyal Hizmet araştırma ve uygulamalarında odak grubu tekniğinden yararlanma. Current Perspectives in Social Sciences, 26, 9-14. doi:10.54614/JSSI.2022.852177
  • Walston, J. & Lissitz, R. (2000). Computer-mediated focus groups. Evaluation Review, 24, 457-483. doi:10.1177/0193841x0002400502
  • Willemsen, R. F., Aardoom, J. J., Chavannes, N. H. & Versluis, A. (2023). Online synchronous focus group interviews: Practical consideration. Qualitative Research, 23, 1810-1820. doi:10.1177/14687941221110161
  • Willig, C. (2019). What can qualitative psychology contribute to psychological knowledge? Psychological Methods, 24, 796–804. doi:10.1037/met0000218
  • Zwaanswijk, M. & Dulmen, S. V. (2014).Advantages of asynchronous online focus groups and face-to-face focus groups as perceived by child, adolescent and adult participants: A survey study. BMC Research Notes, 7, 1-7. doi:10.1186%2F1756-0500-7-756
Year 2024, Volume: 24 Issue: 1, 55 - 72, 31.07.2024
https://doi.org/10.54961/uobild.1489908

Abstract

References

  • Abrams, K. M., Wang, Z., Song, Y. S. & Galindo-Gonzalez, S. (2015). Data richness trade-offs between face-to-face, online audiovisual, and online text-only focus groups. Social Science Computer Review, 33, 80-96. doi:10.1177/0894439313519733
  • Burton, L. J. & Bruening, J. E. (2003). Technology and method intersect in the online focus group. Quest, 55, 315-327. doi:10.1080/00336297.2003.10491807
  • Büyüköztürk, Ş., Kılıç-Çakmak, E., Akgün, Ö. E., Karadeniz, Ş. & Demirel, F. (2021). Eğitimde bilimsel araştırma yöntemleri (31. Baskı). Ankara: Pegem Akademi.
  • Chong, E., Alayli-Goebbels, A., Webel-Edgar, L., Muir, S. & Manson, H. (2015). Advancing telephone focus groups method through the use of Webinar: Methodological reflections on evaluating ontario, Canada’s healthy babies healthy children program. Global Qualitative Nursing Research, 1–8. doi:10.1177/2333393615607840
  • Cibangu, S. K. (2013). A memo of qualitative research for information science: Toward theory construction. Journal of Documentation, 69, 194-213. doi:10.1108/00220411311300048
  • Çokluk, Ö., Yılmaz, K. & Oğuz, E. (2011). Nitel bir görüşme yöntemi: Odak grup görüşmesi. Kuramsal Eğitimbilim, 4, 95-107.
  • Daniels, N., Gillen, P., Casson, K. & Wilson, I. (2019). STEER: Factors to consider when designing online focus groups using audiovisual technology in health research. International Journal of Qualitative Methods, 18, 1-11. doi:10.1177/1609406919885786
  • Deakin, H. & Wakefield, K. (2014). Skype interviewing: Reflections of two PhD researchers. Qualitative Research, 14, 603–616. doi:10.1177/1468794113488126
  • Dos-Santos-Marques, I. C., Theiss, L. M., Johnson, C. Y., McLin, E., Ruf, B. A., Vickers, S. M., … Chu, D. I. (2021). Implementation of virtual focus groups for qualitative data collection in a global pandemic. American Journal of Surgery, 221, 918-922. doi:10.1016%2Fj.amjsurg.2020.10.009
  • Edwards, R. & Holland, J. (2020). Reviewing challenges and the future for qualitative interviewing. International Journal of Social Research Methodology, 23, 581-592.doi:10.1080/13645579.2020.1766767
  • Ergül, Y. (2020). Halkla İlişkiler araştırmalarında çevrimiçi odak grup görüşme tekniği üzerine bir inceleme. 4. Yeni Zamanlar ve Halkla İlişkiler Sempozyumu, 114-122.
  • Flick, U. (2022). Handbook of qualitative research design. SAGE Publications.
  • Freeman, T. (2006). ‘Best practice’ in focus group research: Making sense of different view. Methodological Issues in Nursing Research, 56, 491-497. doi:10.1111/j.1365-2648.2006.04043.x
  • Frost, N. (2021). Qualitative research methods in psychology: Combining core approachies (2nd Edition). McGraw-Hill Education UK.
  • Gibson, S. & Sullivan, C. (2018). A changing culture? Qualitative methods teaching in U.K. psychology. Qualitative Psychology, 5, 197–206. doi:10.1037/qup0000100
  • Glesne, C. (2020). Nitel araştırmaya giriş. Ali Ersoy ve Pelin Yalçınoğlu (Çev.). Ankara: Anı.
  • Gratton, M. F. & O’Donnell, S. (2011). Communication technologies for focus groups with remote communities: A case study of research with First Nations in Canada. Qualitative Research, 11, 159–175. doi:10.1177/1468794110394068
  • Greenspan, S. B., Gordon, K.L., Whitcomb, S. A. & Lauterbach, A. A. (2021). Use of video conferencing to facilitate focus grouyps for qualitative data collection. American Journal of Qualitative Research, 5, 85-93. doi.10.29333/ajqr/10813
  • Gülcan, C. (2021). Nitel bir veri toplama aracı: Odak (focus) grup tekniğinin uygulanışı ve geçerliliği üzerine bir çalışma. Mersin Üniversitesi Sosyal Bilimler Enstitüsü e-Dergisi, 4, 94-109.
  • Hallam, K. F. (2021). Moving on from trials and errors: A discussion on the use of a forum as an online focus group in qualitative research. International Journal of Social Research Methodology, 25, 429-439. doi:10.1080/13645579.2021.1888402
  • Jackson, A. Y. & Mazzei, L. A. (2022). Thinking with theory in qualitative reserach (2nd Edition). London: Routledge.
  • Jarvelin, K. & Vakkari, P. (1993). The evolution of library and information science 1965-1985: A content analysis of journal articles. Information Processing & Management, 29, 129-144. doi:10.1016/0306-4573(93)90028-C
  • Karasar, N. (2020). Bilimsel irade algı çerçevesi ile araştırma yöntemi kavramlar, ilkeler ve teknikler (36. Baskı). Ankara: Nobel.
  • Kazak, A. E. (2018). Editorial: Journal article reporting standarts. American Psychologist, 73, 1-2. doi:10.1037/amp0000263
  • LaMarre, A. & Chamberlain, K. (2022). Innovating qualitative research methods: Proposals and possibilities. Methods in Psychology, 6. doi:10.1016/j.metip.2021.100083
  • Lichtman, M. (2023). Qualitative research in education (4th Edition). New York: Routledge.
  • Marks, L. D., Kelley, H. H. & Galbraith, Q. (2021). Explosion or much ado about little?: A quantitative examination of qualitative publications from 1995-2017. Qualitative Research in Psychology, 1-19. doi:10.1080/14780887.2021.1917740
  • Matthews, K. L., Baird, M. & Duchesne, G. (2018) Using online meeting software to facilitate geographically dispersed focus groups for health workforce research. Qualitative Health Research, 28, 1621–1628. doi:10.1177/1049732318782167
  • Maxwell, J. A. (2019). The value of qualitative inquiry for Public Policy. Qualitative Inquiry, 1-10. doi:10.1177/1077800419857093
  • Moore, T., Mckee, K. & McLoughlin, P. (2015). Online focus groups and qualitative research in the social sciences: Their merits and limitations in a study of housing and youth. People, Place and Policy, 9, 17-28. doi:10.3351/ppp.0009.0001.0002
  • Morse, J. M. (2015). Critical analysis of strategies for determining rigor in qualitative inquiry. Qualitative Health Research, 25, 1212–1222. doi:10.1177/1049732315588501
  • Murgado-Armenteros, E. M., Torres-Ruiz, F. J. & Vega-Zamora, M. (2012). Differences between online and face to face focus groups, viewed through two approaches. Journal of Theoretical and Applied Electronic Commerce Research, 7, 73–86.
  • Reisner, S. L., Randazzo, R. K., White-Hughto, J. M., Peitzmeier, S., DuBois, L. Z., Pardee, D. J., Marrow, E., … Potter, J. (2017) Sensitive health topics with underserved patient populations: Methodological considerations for online focus group discussions. Qualitative Health Research, 28, 1658–1673. doi:10.1177/1049732317705355
  • Rennie, D. L., Watson, K. & Monteiro, A. (2002). The rise of qualitative research in psychology. Canadian Psychology / Psychologie Canadienne, 43, 179–189. doi:10.1037/h0086914
  • Richard, B., Sivo, S. A., Orlowski, M., Ford, R. C., Murphy, J., Boote, D. N. & Witta, E. L. (2021). Qualitative research via focus groups: Will going online affect the diversity of your findings? Cornell Hospitality Quarterly, 62, 32–45. doi:10.1177/1938965520967769
  • Rubin, J. D., Bell, S. & McClelland, S. I. (2018). Graduate education in qualitative methods in U.S. psychology: Current trends and recommendations fort he future. Qualitative Research in Psychology, 15, 29-50. doi:10.1080/14780887.2017.1392668
  • Rupert, D. J., Poehlman, J. A., Hayes, J. J., Ray, S. E. &Moultrie, R. R. (2017). Virtual versus in-person focus groups: Comparison of costs, recruitment, and participant logistics. Journal of Medical Internet Research, 19, e80. doi:10.2196/jmir.6980
  • Saarjiarvi, M. & Bratt, E. L. (2021). When face-to-face interviews are not possible: Tips and tricks for video, telephone, online chat, and email interviews in qualitative research. Europeas Journal of Cardiovascular Nursing, 20, 392-396. doi:10.1093/eurjcn/zvab038
  • Santhosh, L. Rojas, J. C., Garcia, B., Thomashow, M. & Lyons, P. G. (2022). Zooming into focus groups: Strategies for qualitative research in the Era of Social Distancing. National Library of Medicine, 2, 176-184. doi:10.34197%2Fats-scholar.2020-0127PS
  • Savin-Baden, M. & Major, C. (2023). Qualitative research: The essential guide to theory and practice (1st Edition). London: Routledge.
  • Seyidoğlu, H. (2020). Bilimsel araştırma ve yazma el kitabı (12. Baskı). İstanbul: Güzem Can.
  • Schneider, S. J., Kerwin, J., Frechtling, J. & Vivari, B. A. (2002). Characteristics of the discussion in online and face-to-face focus groups. Social Science Computer Review, 20, 31-42. doi:10.1177/089443930202000104
  • Stickley, T. O’Caithain, A. & Homer, C. (2022). The value of qualitative methods to public health research, policy and practice. Perspectives in Public Health, 142, 237-240. doi:10.1177/17579139221083814
  • Synnot, A., Hill, S., Summers, M. & Taylor, M. (2014). Comparing face-to-face and online qualitative research with people with multiple sclerosis. Qualitative Health Research, 24, 431–438. doi:10.1177/1049732314523840
  • Tates, K., Zwaanswijk, M., Otten, R., Dulmen, S. V., Hoogerbrugg, P. M., Kamps, W. A. & Bensing, J. M. (2009). Online focus groups as a tool to collect data in hard-to-include populations: Examples from paediatric oncology. BMC Medical Research Methodology, 9, 1-8.
  • Turney, L. & Pocknee, C. (2005). Virtual focus groups: New frontiers in research. International Journal of Qualitative Methods, 4, 32-43. doi:10.1177/160940690500400203
  • Uslu-Ak, B. (2022). Sosyal Hizmet araştırma ve uygulamalarında odak grubu tekniğinden yararlanma. Current Perspectives in Social Sciences, 26, 9-14. doi:10.54614/JSSI.2022.852177
  • Walston, J. & Lissitz, R. (2000). Computer-mediated focus groups. Evaluation Review, 24, 457-483. doi:10.1177/0193841x0002400502
  • Willemsen, R. F., Aardoom, J. J., Chavannes, N. H. & Versluis, A. (2023). Online synchronous focus group interviews: Practical consideration. Qualitative Research, 23, 1810-1820. doi:10.1177/14687941221110161
  • Willig, C. (2019). What can qualitative psychology contribute to psychological knowledge? Psychological Methods, 24, 796–804. doi:10.1037/met0000218
  • Zwaanswijk, M. & Dulmen, S. V. (2014).Advantages of asynchronous online focus groups and face-to-face focus groups as perceived by child, adolescent and adult participants: A survey study. BMC Research Notes, 7, 1-7. doi:10.1186%2F1756-0500-7-756
There are 51 citations in total.

Details

Primary Language Turkish
Subjects Social Work (Other)
Journal Section Research Article
Authors

Bilge Akar 0000-0001-5704-8783

Sinan Akçay 0000-0001-9485-5891

Publication Date July 31, 2024
Submission Date May 25, 2024
Acceptance Date July 31, 2024
Published in Issue Year 2024 Volume: 24 Issue: 1

Cite

APA Akar, B., & Akçay, S. (2024). NİTEL ARAŞTIRMALARDA ÇEVRİMİÇİ ODAK GRUP GÖRÜŞMELERİ. Ufkun Ötesi Bilim Dergisi, 24(1), 55-72. https://doi.org/10.54961/uobild.1489908