Causation in Tourism Research: A Review of the Use of Experimental Design in Q1 Journals

Yıl 2023, Cilt: 23 Sayı: 3, 657 - 684, 27.09.2023

Seda Sökmen , Merve Dogan , Eniser Atabay

https://doi.org/10.18037/ausbd.1240722

Öz

In this study, it is aimed to develop an understanding of both quantitative and qualitative status of experimental design in tourism research, which is known as the most powerful quantitative method in testing causal relationship. Accordingly, 195 research articles which were published in the pioneer journals (Social Science Citation Index, Q1) of the field of tourism are reviewed without publication year limitation. The articles were analysed in the context of journals, authors, years, and topics using R statistical software and scientific mapping and reporting techniques. Moreover, articles are examined in terms of basic elements of experimental design such as, type, environment, random assignment, manipulation method and manipulation control. According to findings, there has been a remarkable increase in experimental research since 2010 and reaches the peak after 2016. Also, International Journal of Contemporary Hospitality Management, International Journal of Hospitality Management, Journal of Travel Research and Tourism Management are published experimental articles more frequently. Whereas destination image, consumer behaviour, Covid-19, satisfaction etc. are the most prevalent keywords in the articles; well-being, health consciousness, food knowledge etc. are niche topics. In terms of design elements, true experiments, between subjects studies are more frequent and manipulations are checked highly. However, field experiments are rare.

Anahtar Kelimeler

Experimental Design, Causality, Tourism Researches, Systematic Literature Review, Science Mapping

Turizm Araştırmalarında Nedensellik: Q1 Dergilerde Deneysel Tasarımın Kullanımına Yönelik Bir İnceleme

Öz

Bu çalışmada, nedensel ilişkileri test etmede en güçlü nicel yöntem olarak kabul edilen deneysel tasarım konu edilmiştir. Deneysel tasarım yönteminin turizm araştırmalarındaki niceliksel ve niteliksel durumuna ilişkin bir anlayış geliştirilmesi amaçlanmıştır. Bu kapsamda turizm alanında öncü olan ve Social Sciences Citation Index (SSCI)’de taranan dergilerde, deneysel tasarım yöntemi kullanılarak gerçekleştirilmiş 195 araştırma makalesi, yıl sınırlaması olmaksızın incelenmiştir. Makaleler dergiler, yazarlar, yıllar ve konular bağlamında R istatistik programı ile bilimsel haritalama ve raporlama yöntemleri analiz edilmiştir. Ayrıca makaleler deney türü, deney ortamı, tasarım türü, rassal atama, manipülasyon yöntemi ve manipülasyon kontrolü gibi temel deneysel tasarım öğeleri bağlamında da analiz edilmiştir. Bulgular, 2010 yılından itibaren deneysel araştırmalarda dikkat çekici bir artış olduğunu 2016 ve sonrasında ise deneysel tasarım yöntemi kullanımının zirveye ulaştığını ortaya koymuştur. International Journal of Contemporary Hospitality Management, International Journal of Hospitality Management, Journal of Travel Research ve Tourism Management dergilerinin en fazla deneysel tasarım araştırması yayımlayan dergiler olduğu tespit edilmiştir. Destinasyon imajı, tüketici davranışı, Covid-19, tatmin, reklam vb. anahtar kelimelerin deneysel araştırmalarda ön plana çıktığı; sağlık bilinci, iyi oluş, beslenme bilgisi gibi konuların ise niş konular olduğu dikkat çekmektedir. Deneylerin çoğunlukla gerçek deney ve denekler-arası olarak tasarlandığı, rassal atama şartının sağlandığı, saha deneylerinin azınlıkta olduğu ve manipülasyon kontrolüne önem verildiği görülmüştür.

Anahtar Kelimeler

Deneysel Tasarım, Nedensellik, Turizm Araştırmaları, Sistematik Literatür Taraması, Bilimsel Haritalama

Kaynakça

• Aria, M. ve Cuccurullo, C. (2017). Bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959-975. doi: 10.1016/j.joi.2017.08.007
• Atabay, E., Çizel, B. ve Ajanovic, E. (2019). Turizm fotoğraf keşfinde kullanılan yenilikçi yöntemlere panoramic bir yolculuk. C. Cobanoglu, E. Günlü-Küçükaltan, M. Tuna, A. Basoda ve S. Dogan (Ed.), Daha iyi bir dünya için turizm (ss. 523-534) içinde. Florida, ABD: M3 Publishing.
• Baloglu, S. ve Assante, L. M. (1999). A content analysis of subject areas and research methods used in five hospitality management journals. Journal of Hospitality & Tourism Research, 23(1), 53-70. doi: 10.1177/109634809902300105
• Brennan, N. M. (2019). 100 research rules of the game: How to make your research world class; how to successfully publish in top ınternational refereed journals. Accounting, Auditing & Accountability Journal, 32(2), 691-706. doi: 10.1108/AAAJ-02-2019-032
• Büyüköztürk, Ş. (2016). Deneysel desenler öntest-sontest kontrol grubu desen ve veri analizi (5. Baskı). Ankara: Pegem Akademi.
• Büyüköztürk, Ş., Kılıç-Çakmak, E., Akgün, Ö. E., Karadeniz, Ş. ve Demirel, F. (2014). Bilimsel araştırma yöntemleri (17. Baskı). Ankara: Pegem Akademi.
• Chambliss, D. F. ve Schutt, R. K. (2018). Making sense of the social world: Methods of investigation. ABD: Sage Publications.
• Christensen, L. B., Johnson, R. B. ve Turner, L. A. (2015). Research methods, design, and analysis (12. Baskı). ABD: Pearson.
• Clarivate (2022). Changing the way the world’s risk-takers and trailblazers create life-changing innovations. Erişim adresi (10.10.2022): https://clarivate.com/about-us/
• Creswell, J. W. (2014). Araştırma deseni: Nitel, nicel ve karma yöntem yaklaşımları (Çev. Ed. S. B. Demir). Ankara: Eğiten Kitap.
• Dahlstrom, R., Nygaard, A. ve Crosno, J. L. (2008). Strategic, metric, and methodological trends in marketing research and their implications for future theory and practice. Journal of Marketing Theory and Practice, 16(2), 139-152. doi: 10.2753/MTP1069-6679160204
• Dann, G. ve Phillips, J. G. (2001). Qualitatitive tourism research in the late twentieth century and beyond. B. Faulkner, G. Moscardo ve E. Laws (Ed.), Tourism in the twenty-first century: Reflections on experience (ss. 247–265) içinde. Londra: Continuum.
• Dann, G., Nash, D. ve Pearce, P. (1988). Methodology in tourism research. Annals of Tourism Research, 15(1), 1-28. doi: 10.1016/0160-7383(88)90068-0
• Dereli, T., Baykasoglu, A., Altun, K., Durmusoglu, A. ve Türksen, I. B. (2011). Industrial applications of type-2 fuzzy sets and systems: A concise review. Computers in Industry, 62(2), 125-137. doi: 10.1016/j.compind.2010.10.006
• Doğan, V. (2018). Davranışsal ve sosyal bilim araştırmacıları için veri toplama platformu: Amazon Mechanical Turk (Mturk). İstanbul: Beta Yayınevi.
• Doğan, V. (2019). Pazarlama araştırmacıları için deneysel tasarım: Felsefi arka plan ve metodolojik tartışma. Pazarlama Teorisi ve Uygulamaları Dergisi, 5(1), 123-160. Erişim adresi: https://www.betadergi.com/patu/yonetim/icerik/makaleler/62-published.pdf
• Doğan, M. (2022). Araştırmalarda teori kullanımı: Ulusal turizm araştırmaları bağlamında bir inceleme. Eskişehir Osmangazi Üniversitesi Sosyal Bilimler Dergisi, 23(1), 55-70. doi: 10.17494/ogusbd.1017912
• Dolnicar, S. ve Ring, A. (2014). Tourism marketing research – past, present and future. Annals of Tourism Research, 47, 31-47. doi: 10.1016/j.annals.2014.03.008
• Dolnicar, S., Coltman, T. ve Sharma, R. (2015). Do satisfied tourists really intend to come back? Three concerns with empirical studies linking satisfaction to behavioral intentions. Journal of Travel Research, 54(2), 152-178. doi: 10.1177/0047287513513167
• Echtner, C. M. ve Jamal, T. B. (1997). The disciplinary dilemma of tourism studies. Annals of Tourism Research, 24(4), 868-883. doi: 10.1016/S0160-7383(97)00060-1
• Egghe, L. (2006). Theory and practise of the g-index. Scientometrics, 69(1), 131-152. doi: 10.1007/s11192-006-0144-7
• Ence, A. K., Cope, S. R., Holliday, E. B. ve Somerson, J. S. (2016). Publication productivity and experience: Factors associated with academic rank among orthopaedic surgery faculty in the United States. The Journal of Bone and Joint Surgery, 98(10), e41. doi: 10.2106/JBJS.15.00757
• Faulkner, B. ve Goeldner, C. R. (1998). Progress in tourism and hospitality research. Journal of Travel Research, 37(1), 76-80. doi: 10.1177/004728759803700111
• Field, A. ve Hole, G. (2003). How to design and report experiments. Büyük Britanya: Sage Publications.
• Fong, L. H. N., Gursoy, D. ve Sigala, M. (2020). Experimental research in tourism. Asia Pacific Journal of Tourism Research, 25(7), 707-709. doi: 10.1108/IJCHM-10-2014-0506
• Fong, L. H. N., Law, R., Tang, C. M. F. ve Yap, M. H. T. (2016). Experimental research in hospitality and tourism: A critical review. International Journal of Contemporary Hospitality Management, 28(2), 246-266. doi: 10.1108/IJCHM-10-2014-0506
• Fraenkel, J. R. ve Wallen, N. E. (2006). How to design and evaluate research in education (6. Baskı). New York: McGraw-Hill International Edition.
• Gonzalez, R. (2009). Data analysis for experimental design. New York: Guilfor Press.
• Hair, J. F., Black, B., Babin, B. J. ve Anderson, R. E. (2014). Multivariate data analysis: Global edition (7. Baskı). ABD: Pearson.
• Hirsch, J. E. (2005). An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences, 102(46), 16569-16572. doi: 10.1073/pnas.0507655102
• Hsieh, H. F. ve Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277-1288. doi: 10.1177/1049732305276687
• Jerit, J., Barabas, J. ve Clifford, S. (2013). Comparing contemporaneous laboratory and field experiments on media effects. Public Opinion Quarterly, 77(1), 256-282. doi: 10.1093/poq/nft005
• Kemperman, A. (2021). A review of research into discrete choice experiments in tourism: Launching the Annals of Tourism Research Curated Collection on Discrete Choice Experiments in Tourism. Annals of Tourism Research, 87, 103137. doi: 10.1016/j.annals.2020.103137
• Keppel, G. ve Wickens, T. D. (2004). Design and analysis: A researcher's handbook (4. Baskı). New Jersey: Pearson.
• Khoo-Lattimore, C., Mura, P. ve Yung, R. (2019). The time has come: A systematic literature review of mixed methods research in tourism. Current Issues in Tourism, 22(13), 1531-1550. doi: 10.1080/13683500.2017.1406900
• Kirk, R. E. (2012). Experimental design. I. B. Weiner (Ed.), Handbook of psychology (ss. 3-32) içinde. ABD: Wiley.
• Larsen, S. (2007). Aspects of a psychology of the tourist experiences. Scandinavian Journal of Hospitality & Tourism, 7(1), 7-18. doi: 10.1080/15022250701226014
• Law, R., Leung, D., Au, N. ve Lee, H. A. (2012). Progress and development of information technology in the hospitality industry: Evidence from cornell hospitality quarterly. Cornell Hospitality Quarterly, 54(1), 10-24. doi: 10.1177/1938965512453199
• Leung, R. ve Law, R. (2007). Information technology publications in leading tourism journals: A study of 1985 to 2004. Information Technology & Tourism, 9(2), 133-144. doi: 10.3727/109830507781367357
• Levy, S. E., Getz, D. ve Hudson, S. (2011). A field experimental investigation of managerially facilitated consumer-to-consumer interaction. Journal of Travel & Tourism Marketing, 28(6), 656-674. doi: 10.1080/10548408.2011.603633
• Line, N. D. ve Runyan, R. C. (2012). Hospitality marketing research: Recent trends and future directions. International Journal of Hospitality Management, 31(2), 477-488. doi: 10.1016/j.ijhm.2011.07.006
• Lupton, R. C. ve Allwood, J. M. (2017). Hybrid Sankey diagrams: Visual analysis of multidimensional data for understanding resource use. Resources, Conservation and Recycling, 124, 141-151. doi: 10.1016/j.resconrec.2017.05.002
• Lynn, A. ve Lynn, M. (2003). Experiments and quasi-experiments: methods for evaluating marketing options. Cornell Hotel & Restaurant Administration Quarterly, 44(2), 75-84. doi: 10.1016/S0010-8804(03)90020-6
• Mattila, A. S. (2004). Consumer behavior research in hospitality and tourism journals. International Journal of Hospitality Management, 23(5), 449-457. doi: 10.1016/j.ijhm.2004.10.001
• Mattila, A. S., Luo, A., Xue, X. ve Ye, T. (2020). How to avoid common mistakes in experimental research?. International Journal of Contemporary Hospitality Management, 33(1), 367-374. doi: 10.1108/IJCHM-07-2020-0696
• Morley, C. (2012). Discrete choice analysis and experimental design. L. Dwyer, A. Gill ve N. Seetaram (Ed.), Handbook of research methods in tourism (ss. 113-126) içinde. ABD: Edward Elgar Publishing.
• Morley, C. L. (1994). Experimental destination choice analysis. Annals of Tourism Research, 21(4), 780-791. doi: 10.1016/0160-7383(94)90083-3
• Morosan, C., Bowen, J. T. ve Atwood, M. (2014). The evolution of marketing research. International Journal of Contemporary Hospitality Management, 26(5), 706-726. doi: 10.1108/IJCHM-11-2013-0515
• Muñoz-Leiva, F., Viedma-del-Jesús, M. I., Sánchez-Fernández, J. ve López-Herrera, A. G. (2012). An application of co-word analysis and bibliometric maps for detecting the most highlighting themes in the consumer behaviour research from a longitudinal perspective. Quality & Quantity, 46(4), 1077-1095. doi: 10.1007/s11135-011-9565-3
• Myers, A. ve Hansen, C. (2012). Experimental psychology (7. Baskı). Kaliforniya: Wadsworth.
• Namasivayam, K. (2004). Repeated measures experimentation in hospitality research: a brief overview. Journal of Hospitality & Tourism Research, 28(1), 121-129. doi: 10.1177/1096348003261220
• Neuman, W. L. (2016). Toplumsal araştırma yöntemleri: Nitel ve nicel yaklaşımlar 2 (Çev. S. Özge). Ankara: Yayın Odası.
• Nunkoo, R. (2018). The state of research methods in tourism and hospitality. R. Nunkoo (Ed.), Handbook of research methods for tourism and hospitality management (ss. 3-23) içinde. ABD: Edward Elgar Publishing.
• Nunkoo, R., Ramkissoon, H. ve Gursoy, D. (2013). Use of structural equation modeling in tourism research: Past, present, and future. Journal of Travel Research, 52(6), 759-771. doi: 10.1177/0047287513478503
• Nunkoo, R., Thelwall, M., Ladsawut, J. ve Goolaup, S. (2020). Three decades of tourism scholarship: Gender, collaboration and research methods. Tourism Management, 78, 104056. doi: 10.1016/j.tourman.2019.104056
• Oh, H., Kim, B. Y. ve Shin, J. H. (2004). Hospitality and tourism marketing: Recent developments in research and future directions. International Journal of Hospitality Management, 23(5), 425-447. doi: 10.1016/j.ijhm.2004.10.004
• Pahlevan-Sharif, S., Mura, P. ve Wijesinghe, S. N. (2019). A systematic review of systematic reviews in tourism. Journal of Hospitality and Tourism Management, 39, 158-165. doi: 10.1016/j.jhtm.2019.04.001
• Palmatier, R. W., Houston, M. B. ve Hulland, J. (2018). Review articles: Purpose, process, and structure. Journal of the Academy of Marketing Science, 46(1), 1-5. doi: 10.1007/s11747-017-0563-4
• Punch, K. F. (2011). Sosyal araştırmalara giriş nicel ve nitel yaklaşımlar (Çev. D. Bayrak, H. B. Arslan ve Z. Akyüz). Ankara: Siyasal Kitabevi.
• Riley, R. W. ve Love, L. L. (2000). The state of qualitative tourism research. Annals of Tourism Research, 27(1), 164-187. doi: 10.1016/S0160-7383(99)00068-7
• Rossiter, J. R. (2001). What is marketing knowledge? Stage I: Forms of marketing knowledge. Marketing Theory, 1, 9–26. doi: 10.1177/147059310100100101
• Rossiter, J. R. (2002). The five forms of transmissible, usable marketing knowledge. Marketing Theory, 2, 369–380. doi: 10.1177/147059310200200407
• Ruble, R. A. (2017). Experimental manipulation. M. Allen (Ed.), The sage encyclopedia of communication research methods (ss. 474-477) içinde. ABD: Sage Publications.
• Saab, M., Dartus, J., Erivan, R., Reina, N., Ollivier, M. ve Devos, P. (2019). Publication output of French orthopedic and trauma surgeons: Quantitative and qualitative bibliometric analysis of their scientific production in orthopedics and other medical fields. Orthopaedics & Traumatology: Surgery & Research, 105(8), 1439-1446. doi: 10.1016/j.otsr.2019.09.018
• Scott, N., Zhang, R., Le, D. ve Moyle, B. (2019). A review of eye-tracking research in tourism. Current Issues in Tourism, 22(10), 1244-1261. doi: 10.1080/13683500.2017.1367367
• Shadish, W., Cook, T. D. ve Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. ABD: Houghton Mifflin.
• Shoemaker, P. J., Tankard Jr, J. W. ve Lasorsa, D. L. (2004). How to Build Social Science Theories. CA: Sage Publications.
• Sığırcı, Ö. (2023). Deneysel Araştırma Tasarımı ve Pazarlama Araştırmalarında Deneysel Araştırma Tasarımı Kullanan Yayınların İncelenmesi. TroyAcademy, 8(1), 101-135. doi: 10.31454/troyacademy.1235967
• Sop, S. A. ve Kozak, M. (2021). Araştırma yöntemleri bilgisinin önemi: Turizm alanına yönelik bir gömülü teori çalışması. Anatolia: Turizm Araştırmaları Dergisi, 32(2), 171-183. doi: 10.17123/atad.756946
• Sökmen, S. ve Doğan, M. (2021). Ulusal turizm araştırmalarında deneysel tasarım kullanımı. C. Avcıkurt, A. Köroğlu ve O. İlban (Ed.), 21. Ulusal – 5. Uluslararası Turizm Kongresi Bildirler Kitabı (ss. 974-983) içinde. Ankara: Detay Yayıncılık.
• Sun, S., Law, R. ve Zhang, M. (2020). An updated review of tourism-related experimental design articles. Asia Pacific Journal of Tourism Research, 25(7), 710-720. doi: 10.1080/10941665.2019.1699128
• Tasci, A. D. A., Gartner, W. C. ve Cavusgil, S. T. (2007). Measurement of destination brand bias using a quasi-experimental design. Tourism Management, 28(6), 1529-1540. doi: 10.1016/j.tourman.2007.02.009
• Tavakoli, R. ve Wijesinghe, S. N. (2019). The evolution of the web and netnography in tourism: A systematic review. Tourism Management Perspectives, 29, 48-55. doi: 10.1016/j.tmp.2018.10.008
• Toy, B. Y. ve Tosunoğlu, N. G. (2007). Sosyal bilimler alanındaki araştırmalarda bilimsel araştırma süreci, istatistiksel teknikler ve yapılan hatalar. Gazi Üniversitesi Ticaret ve Turizm Eğitim Fakültesi Dergisi, 1, 1-20. Erişim Adresi: https://dergipark.org.tr/en/download/article-file/842689
• Tribe, J. ve Airey, D. (Ed.) (2007). A review of tourism research. J. Tribe ve D. Airey (Ed.), Developments in tourism research (ss. 19-30) içinde. ABD: Routledge.
• Veal, A. J. (2018). Research methods for leisure and tourism (5. Baskı). Birleşik Krallık: Pearson.
• Viglia, G. ve Dolnicar, S. (2020). A review of experiments in tourism and hospitality. Annals of Tourism Research, 80, 102858. doi: 10.1016/j.annals.2020.102858
• Wong, A. K. F., Koseoglu, M. A. ve Kim, S. (2021). Creation and dissemination of hospitality and tourism research outputs in the new millennium. International Journal of Contemporary Hospitality Management, 33(2), 377-401. doi: 10.1108/IJCHM-05-2020-0493
• Xiao, H. ve Smith, S. L. (2006a). Case studies in tourism research: A state-of-the-art analysis. Tourism Management, 27(5), 738-749. doi: 10.1016/j.tourman.2005.11.002
• Xiao, H. ve Smith, S. L. (2006b). The making of tourism research: Insights from a social sciences journal. Annals of Tourism Research, 33(2), 490-507. doi: 10.1016/j.annals.2006.01.004
• Xin, S., Tribe, J. ve Chambers, D. (2013). Conceptual research in tourism. Annals of Tourism Research, 41(1), 66-88. doi: 10.1016/j.annals.2012.12.003
• Yoo, M., Lee, S. ve Bai, B. (2011). Hospitality marketing research from 2000 to 2009: Topics, methods, and trends. International Journal of Contemporary Hospitality Management, 23(4), 517-532. doi: 10.1108/09596111111130010
• Zhang, J., Yu, Q., Zheng, F., Long, C., Lu, Z. ve Duan, Z. (2016). Comparing keywords plus of WOS and author keywords: A case study of patient adherence research. Journal of the Association for Information Science and Technology, 67(4), 967-972. doi: 10.1002/asi.23437