Website Performance Evaluation by Grey Relational Analysis: A Research on Companies in BIST Technology and Informatics Index

Year 2023, Volume: 7 Issue: 1, 47 - 58, 02.01.2024

Hülya Başeğmez , Kadir Özdemir

https://doi.org/10.26650/acin.1165100

Abstract

Since websites are the visible face of companies, they are a significant determinant of how customers perceive interactions. Websites give the first impression of ensuring customer satisfaction and meeting expectations. Therefore, a quality website will provide competitive advantages. In this study, the website performance of 27 businesses in the BIST Technology and Informatics Index was evaluated, and 24 websites were analysed because the websites of three companies gave analysis errors. Website performance was measured by Page Size (Mb), Onload Time (s), First contentful paint (ms), Performance Score (%), Largest Contentful Paint (ms), Total Blocking Time (ms) and Speed Index (ms) criteria. The performance evaluation criteria of the websites were determined based on the literature and expert opinion. The data of the websites were obtained from GTmetrix automated test tool and analysed by using the Grey Relational Analysis (GRA) method. As a result of the analysis, companies’ websites were ranked according to their performance score. Accordingly, Alcatel-Lucent, Plastik Kart, Escort, Smartiks, and Papilon have the highest website performance scores and are in the top five. Aselsan, Index, Datagate, Despec and Mia Teknoloji have the lowest performance scores.

Keywords

Website Performance Evaluation, Grey Relational Analysis (GRA), GTmetrix

Gri İlişkisel Analiz ile Web Site Performans Değerlendirmesi: BIST Teknoloji ve Bilişim Endeksi Üzerine Bir Araştırma

Abstract

Web siteler, işletmelerin görünen yüzü olduğundan işletmelerin müşteriler tarafından nasıl algılanacağının önemli belirleyicisidir. Müşteri memnuniyetinin sağlanması ve beklentilerin karşılanması noktasında web siteler ilk izlenimi vermektedir. Dolayısıyla kaliteli bir web sitesine sahip olmak işletmelere rakipleri karşısında avantajlar sağlayacaktır. Bu çalışmada BİST Teknoloji ve Bilişim Endeksi’nde yer alan 27 işletmenin web site performansı değerlendirilmiş olup üç işletmenin web sitesi analiz hatası verdiği için 24 web sitesinin analizi yapılmıştır. Web sitelerin performansı sayfa boyutu, yüklenme süresi, FCP (First Contentful Paint), performans skoru, LCP (Largest Contentful Paint), toplam engelleme süresi ve hız endeksi kriterleri kullanılarak ölçülmüştür. Kriterler uzman görüşüne ve literatüre dayanarak belirlenmiştir. Web sitelere ait veriler GTmetrix otomatik test aracı kullanılarak elde edilmiş olup Gri İlişkisel Analiz (GRA) yöntemi kullanılarak analiz edilmiştir. Analizler sonucunda şirketlere ait web siteler performans skorlarına göre sıralanmıştır. Buna göre Alcatel-Lucent, Plastik Kart, Escort, Smartiks, ve Papilon şirketleri en yüksek web sitesi performans skoruna sahiptir ve ilk beşte sırada yer almaktadır. Ayrıca Aselsan, Index, Datagate, Despec ve Mia Teknoloji şirketleri en düşük web sitesi performans skoruna sahiptir.

Keywords

Web Site Performans Değerlendirmesi, Gri İlişkisel Analiz (GRA), GTmetrix

References

• Acır, A., Canlı, M. E., Ata, İ., & Çakıroğlu, R. (2017). Parametric optimization of energy and exergy analyses of a novel solar air heater with grey relational analysis. Applied Thermal Engineering, 122, 330-338. google scholar
• Al-Sakran, H. O., & Alsudairi, M. A. (2021). Usability and accessibility assessment of Saudi Arabia mobile e-government websites. IEEE Access, 9, 48254-48275. google scholar
• Benaida, M., & Namoun, A. (2018). Technical and perceived usability issues in Arabic educational websites. International Journal of Advanced Computer Science and Applications, 9(5), 391-400. google scholar
• Belinda, B. I., Kayode, A. B., Solomon, N., & Favour-Bethy, T. A. (2021). Analysis of internal and external website usability factors. Communications on Applied Electronics (CAE), 7 (35), 9-18. google scholar
• Bilal, M., Yu, Z., Song, S., & Wang, C. (2019). Evaluate accessibility and usability issues of particular China and Pakistan government websites. In 2019 2nd International Conference on Artificial Intelligence andBig Data (ICAIBD) 316-322. IEEE. google scholar
• Csontos, B., & Heckl, I. (2021). Accessibility, usability, and security evaluation of Hungarian government websites. Universal Access in the Information Society, 20(1), 139-156. google scholar
• Çekici, E. M. & Babacan, Ş. F. (2022). Gri İlişkisel Analiz ile Kurumsal Yönetim ve Finansal Performans Karşılaştırması: Borsa İstanbul’da Bir Uygulama. Marmara Üniversitesi İktisadi ve İdari Bilimler Dergisi , 44 (1) , 221-238 . DOI: 10.14780/muiibd.1135582 google scholar
• Dawis, A. M., & Setiawan, I. (2022). Evaluation of the website Aisyiyah Surakarta of University performance based on search engine optimization using automated software testing Gtmetrix. International Journal of Computer and Information System (IJCIS), 5(1), 17-20. google scholar
• Dehghan-Manshadi, B., Mahmudi, H., Abedian, A., & Mahmudi, R. (2007). A novel method for materials selection in mechanical design: combination of non-linear normalization and a modified digital logic method. Materials & design, 25(1), 8-15. google scholar
• Dinler, S. Turkiye’de faaliyet gosteren hayat dısı sigorta şirketlerinin gri ilişkisel analizi ile performansının değerlendirilmesi. Oltu Beseri ve Sosyal Bilimler Fakultesi Dergisi, 2(2), 200-212. google scholar
• Ecer, F., & Gunay, F. (2015). Borsa İstanbul’da işlem goren turizm şirketlerinin finansal performanslarının gri ilişkisel analiz yöntemiyle ölçülmesi. Anatolia: Turizm Arastırmaları Dergisi, 25(1), 35-48. google scholar
• Gavcar, C. T., & Organ, A. (2020). AHP-Gri İliskisel Analiz ve AHP-WASPAS yöntemleri ile online satıs yapan seyahat acentalarinin değerlendirilmesi. Business & Management Studies: An International Journal, 8(1), 731-753. google scholar
• GTmetrix. (2022a). GTmetrix performance blog. Retrieved From https://gtmetrix.com/blog/browser-timings/#onload-time. Date of access: 13.04.2022. google scholar
• GTmetrix. (2022c). Everything you need to know about the new GTmetrix Report (powered by Lighthouse). Retrieved From https://gtmetrix.com/blog/ everything-you-need-to-know-about-the-new-gtmetrix-report-powered-by-lighthouse/#performance-score. Date of access: 15.04.2022. google scholar
• GTmetrix. (2022d). Lighthouse: Largest Contentful Paint. Retrieved From https://gtmetrix.com/largest-contentful-paint.html. Date of access: 15.04.2022. google scholar
• GTmetrix. (2022e). Lighthouse: Total Blocking Time. Retrieved From https://gtmetrix.com/total-blocking-time.html. Date of access: 15.04.2022. google scholar
• Guru, S., & Mahalik, D. K. (2019). A comparative study on performance measurement of Indian public sector banks using AHP-TOPSIS and AHP-grey relational analysis. Opsearch, 56(4), 1213-1239. google scholar
• Gunay, F., Karadeniz, E., & Dalak, S. (2018). Turkiye’de en yuksek net satıs gelirine sahip 20 şirketin finansal performanslarının gri ilişkisel analiz yöntemiyle incelenmesi. Omer Halisdemir Üniversitesi İktisadi ve İdari Bilimler Fakultesi Dergisi, 11(2), 51-73. google scholar
• Hossain, M., Hassan, R., Amjad, M., & Rahman, M. (2021). Web performance analysis: An empirical analysis of e-commerce sites in Bangladesh. International Journal of Information Engineering & Electronic Business, 13(4), 47-54. google scholar
• Ju-Long, Deng (1982). Control problems of grey systems. Systems & control letters, 1(5), 288-294. google scholar
• Ju-Long, Deng (1989). Introduction to grey system theory. The Journal of grey system, 1(1), 1-24. google scholar
• Kaur, S., Kaur, K., & Kaur, P. (2016). An empirical performance evaluation of universities website. International Journal of Computer Applications, 146(15), 10-16. google scholar
• Kula, V., Kandemir, T., & Baykut, E. (2016). Borsa İstanbul’da işlem goren sigorta ve BES şirketlerinin finansal performansının gri ilişkisel analiz yöntemi ile incelenmesi. Journal of Economics andAdministrative Sciences, 17(1), 37-53. google scholar
• Kung, C. Y., Yan, T. M., & Chuang, S. C. (2006). GRA to Assess the Operating Performance of Non-Life Insurance Companies in Taiwan. Journal of Grey System, 18(2). google scholar
• Lin, C. L. (2004). Use of the Taguchi method and grey relational analysis to optimize turning operations with multiple performance characteristics. Materials and manufacturing processes, 19(2), 209-220. google scholar
• Maruf, M. and Ozdemir, K. (2021). Turkiye’deki ticari bankalara ait web sitelerin performanslarının SWARA ve ARAS yöntemi ile sıralanması. OPUS-Uluslararası Toplum Arastırmaları Dergisi, 18(Yonetim ve Organizasyon Ozel Sayısı), 1514-1537. google scholar
• Mercangoz, B. A., Calıskan, B. O. O., & Yıldırım, B. F. (2018). Fortune 500 Turkiye’de yer alan lojistik isletmelerinin sosyal medya kullanımının analizi ve değerlendirilmesi. İsletme Arastırmaları Dergisi, 10(4), 1321-1341. google scholar
• Mia, M., Rifat, A., Tanvir, M. F., Gupta, M. K., Hossain, M. J., & Goswami, A. (2018). Multi-objective optimization of chip-tool interaction parameters using Grey-Taguchi method in MQL-assisted turning. Measurement, 129, 156-166. google scholar
• Nacar, R., & Ozdemir, K. (2021). E-ticaret pazaryeri web sitelerinin dinamikleri: covid-19 pandemi sürecindeki değişim. Eskişehir Osmangazi Üniversitesi İktisadi ve İdari Bilimler Dergisi, 16(1), 205-226. google scholar
• Ozbek, A. (2020). Web Sitesi Kalitesinin MULTIMOORA Yöntemi İle Değerlendirilmesi. International Journal of Engineering Research and Development, 12(2), 479-491. google scholar
• Ozdemir, M. and Turna, G. B. (2020). Website performances of commercial banks in Turkey. Dumlupınar Üniversitesi Sosyal Bilimler Dergisi, 64, 38-52. google scholar
• Rababah, O., & Masoud, F. (2010). Key factors for developing a successful e-commerce website. Communications of the IBIMA, 2010, 1-9. google scholar
• Rajesh, R., & Ravi, V. (2015). Supplier selection in resilient supply chains: a grey relational analysis approach. Journal of Cleaner Production, 86, 343-359. google scholar
• Ramesh, K., Baranitharan, P., & Sakthivel, R. (2019). Investigation of the stability on boring tool attached with double impact dampers using Taguchi based Grey analysis and cutting tool temperature investigation through FLUKE-Thermal imager. Measurement, 131, 143-155. google scholar
• Sahin, Y., & Aydemir, E. (2019). Akıllı telefon teknik ozellik onem derecelerinin AHP ağırlıklı gri ilişkisel analizi yöntemi ile belirlenmesi. Eskisehir Osmangazi Üniversitesi İktisadi ve İdari Bilimler Dergisi, 14(1), 225-238. google scholar
• Salvio, K. B. V., & Palaoag, T. D. (2019, April). Evaluation of the selected Philippine e-government websites’ performance with prescriptive analysis. In google scholar
• Proceedings of the 2019 5th International Conference on Computing and Artificial Intelligence, 129-137. google scholar
• Sandeep, M., Kumanan, S., & Vinodh, S. (2011). Supplier selection using combined AHP and GRA for a pump manufacturing industry. International Journal of Logistics Systems and Management, 10(1), 40-52. google scholar
• Shemshadi, A., Shirazi, H., Toreihi, M., & Tarokh, M. J. (2011). A fuzzy VIKOR method for supplier selection based on entropy measure for objective weighting. Expert systems with applications, 38(10), 12160-12167. google scholar
• Soylemez, E. Y., Kayabası, A., & Doğan, S. (2021). Seramik sektoru tedarikci secim surecinde gri ilişkisel analiz (GİA) ile entegre edilmis analitik hiyerarsi prosesi (AHP) modeli. İzmir İktisat Dergisi, 36(3), 497-516. google scholar
• Stringam, B., & Gerdes, J. (2019). Service gap in hotel website load performance. International Hospitality Review. 33(1), 16-29. google scholar
• Sun, S., Zhou, S., & Zhao, X. (2013). Analysis of Construction contractor selection and evaluation based on AHP and GRA. In ICCREM 2013: Construction and Operation in the Context of Sustainability (pp. 36-44). google scholar
• Suvvari, A., Durai, S., R., & Goyari, P. (2019). Financial performance assessment using Grey relational analysis (GRA): An application to life insurance companies in India. Grey Systems: Theory and Application. 9(4), 502-516. google scholar
• Tsai, W. H., Chou, W. C., & Leu, J. D. (2011). An effectiveness evaluation model for the web-based marketing of the airline industry. Expert Systems with Applications, 38(12), 15499-15516. google scholar
• Tzeng, C. J., Lin, Y. H., Yang, Y. K., & Jeng, M. C. (2009). Optimization of turning operations with multiple performance characteristics using the Taguchi method and Grey relational analysis. Journal of materials processing technology, 209(6), 2753-2759. google scholar
• Uzun, G. (2019). Analysis of grey relational method of the effects on machinability performance on austempered vermicular graphite cast irons. Measurement, 142, 122-130. google scholar
• Vatansever, K., & Akgül, Y. (2018). Performance evaluation of websites using entropy and grey relational analysis methods: The case of airline companies. Decision Science Letters, 7(2), 119-130. google scholar
• Wang, B. T., Sheu, T. W., Liang, J. C., Tzeng, J. W., & Nagai, M. (2012, December). Optimal method for choosing an English coursebook by using GRA and AHP. In 2012 IEEE/SICE International Symposium on System Integration (SII) (pp. 558-562). IEEE. google scholar
• Wang, P., Meng, P., Zhai, J. Y., & Zhu, Z. Q. (2013). A hybrid method using experiment design and grey relational analysis for multiple criteria decision making problems. Knowledge-Based Systems, 53, 100-107. google scholar
• Wang, T. K., Zhang, Q., Chong, H. Y., & Wang, X. (2017). Integrated supplier selection framework in a resilient construction supply chain: An approach via analytic hierarchy process (AHP) and grey relational analysis (GRA). Sustainability, 9(2), 289. google scholar
• Wuwei, L. (2009). Research on evaluation of e-commerce website based on grey relational analysis. International Forum on Information Technology and Applications (Vol. 2, pp. 473-476). IEEE. google scholar
• Yıldırım, M., Kıvanç, B. A. L., & Doğan, M. (2021). Gri İlişkisel Analiz Yöntemi ile Finansal Performans Analizi: Bist’te İşlem Gören Demir Çelik Şirketleri Üzerinde Bir Uygulama. Muhasebe Bilim Dünyası Dergisi, 23(1), 122-143. google scholar
• Yuan, C., Wu, D., & Liu, H. (2017). Using grey relational analysis to evaluate energy consumption, CO2 emissions and growth patterns in China’s provincial transportation sectors. International journal of environmental research andpublic health, 14(12), 1536. google scholar
• Zerti, O., Yallese, M., Zerti, A., Belhadi, S., & Girardin, F. (2018). Simultaneous improvement of surface quality and productivity using grey relational analysis based Taguchi design for turning couple (AISI D3 steel/mixed ceramic tool (Al2O3+ TiC)). International Journal of Industrial Engineering Computations, 9(2), 173-194. google scholar
• Zhang, H. (2018). Evalution model of website usability. In IOP Conference Series: Materials Science and Engineering, 394 (3), 03253, IOP Publishing. google scholar
• Zhang, P., Dran, G. M., Small, R. V., & Barcellos, S. (1999). Websites that satisfy users: A theoretical framework for web user interface design and evaluation. Proceedings of the Hawaii International Conference on System Sciences. google scholar