Validity and Reliability Evidence of Professional Obsolescence Scale According to Different Test Theories

Year 2021, Volume: 8 Issue: 2, 257 - 278, 10.06.2021

Sadegül Akbaba Altun , Şener Büyüköztürk , Merve Yıldırım Seheryeli

https://doi.org/10.21449/ijate.786466

Abstract

This study aims to develop a scale that will determine the factors causing professional obsolescence in the field of education. In this context, the Professional Obsolescence Scale (POS) has been developed to determine the professional and organizational obsolescence of primary, secondary and high school administrators. In this scale development process, steps were followed in line with the suggestions of Crocker and Algina (2006) and Cronbach (1984). Firstly, 63 items were prepared and 991 school principals participated the study. R (version 4.0.1) software was used to analyze the data. Item and test parameters and information functions have been estimated using Samejima’s Graded Response Model based on Item Response Theory. Principal Axis Analysis was performed for the construct validity of the scale, and four-dimensions structure with 47 items has been obtained. These dimensions are named as “Being Open to Professional Development”, “Job-Ability Harmony in Profession”, “Organizational Support in Professional Development”, “Professional Burnout”. The scores obtained from each dimension are evaluated within themselves. It has been observed that each dimension fulfills the conditions of unidimensionality, local independence, model-data fit and parameter invariance. According to the Classical Test Theory, Cronbach Alpha coefficients are between 0.807 and 0.945. The Stratified Alpha coefficient calculated for the whole scale is 0.94. According to the Item Response Theory, the marginal reliability coefficients were between 0.857 and 0.936 and the empirical reliability coefficients were found between 0.854 and 0.938.

Keywords

school principals, professional obsolescence, scale development, professional development activities

References

• Akbaş, U., Karabay, E., Yıldırım-Seheryeli, M., Ayaz, A., & Demir, Ö. O. (2019). Comparison of Exploratory Factor Analysis Studies in Turkish Measurement Tools Index According to Parallel Analysis Results. Journal of Theoretical Educational Science, 12(3), 1095-1123. https://doi.org/10.30831/akukeg.453786
• Baker, F. B. (2016). Madde Tepki Kuramının Temelleri [Fundamentals of Item Response Theory]. (N. Güler, Ed., & M. İlhan, Çev.) Pegem Akademi.
• Başaran, İ.E. (2008). Örgütsel Davranış [Organizational Behavior]. Ekinoks Yayınları.
• Burke, R.J. (1969). Effects of aging on engineer’s satisfactions and mental health: Skill obsolescence, Academy of Management Journal, 12(4), 479 486. https://doi.org/10.5465/254736
• Büyüköztürk, Ş. (2019). Sosyal Bilimler İçin Veri Analizi El Kitabı [Manual of Data Analysis for Social Sciences] (26. baskı). Pegem Akademi.
• Chauhan, S.P., & Chauhan, D. (2004). Professional Obsolescence: Causes and Preventive Measures. Indian Journal of Industrial Relations, 39(3), 347 363. http://www.jstor.org/stable/27767911
• Chauhan, S.P., & Chauhan, D. (2005). Overcoming Managerial Obsolescence: The key to human development. Pritam Singh, Ajay Singh, and Daisy Chauhan, (Eds.), in Creating Value Through People (pp. 321-38). Excel Books.
• Chauhan, S.P., & Chauhan, D. (2008). Human Obsolescence: A Wake-up Call to Avert a Crisis. Global Business Review, 9(1), 85-100. https://doi.org/10.1177/097215090700900106
• Chauhan, S.P., & Chauhan, D. (2009). Are you on the verge of obsolescence? Indian Journal of Industrial Relations, 44(4), 646-659.
• Crocker, L., & Algina, J. (2006). Introduction to Classical and Modern Test Theory. Cengage Learning.
• Cronbach, L. J., Schonemann, P., & McKie, D. (1965). Alpha coefficients for stratified-paralel tests. Educational and Psychological Measurement, 25, 291 312. https://doi.org/10.1177/001316446502500201
• Cronbach, L. J. (1984). Essentials of Psychological Testing (4th ed). Harper Row.
• Çokluk, Ö., Şekercioğlu, G., & Büyüköztürk, Ş. (2014). Sosyal Bilimler İçin Çok Değişkenli İstatistik SPSS ve LISREL Uyglamaları [Multivariate Statistics for Social Sciences: SPSS and LISREL Applications]. Pegem Akademi.
• DeMars, C. (2010). Item Response Theory. Oxford University Press.
• Embretson, S.E., & Reise, S.P. (2000). Item Response Theory for Psychologists. Lawrence Erlbaum Associates.
• Field, A. (2009). Discovering Statistics Using SPSS (3rd ed.). Sage Publications Ltd.
• Fossum, J. A., Arvey, R.D., Paradise, C.A., & Robbins, N. E. (1986). Modeling the Skills Obsolescence Process: A Psychological/Economic Integration, Academy of Management Review, 11(2), 362-374.
• Hambleton, R. K., & Swaminathan, H. (1985). Item Response Theory: Principles and Applications. Kluwer Nijhoff Publishing.
• Jones, E., Chonko, L.B., & Roberts, J.A. (2003). Sales for obsolescence: Perceptions from sales and marketing executives of individual, organizational, and enviornmental factors. Industrial Marketing Management, 33, 439-456.
• Knight, P. (1998). Professional obsolescence and continuing professional development in higher education, Innovations in Education and Teaching International, 35(3), 248-256. https://doi.org/10.1080/1355800980350309
• MacNeill, N., & Cavanagh, R. (2006). Principals’ pedagogic obsolescence: re-assessing what is important in schools. Curriculum and Leadership Journal, 4(29). http://www.curriculum.edu.au/leader/principals_pedagogic_obsolescence:_re assessing_wh,15968.html?issueID=10421
• Millî Eğitim Bakanlığı (MEB) Eğitim Kurumları Yöneticilerinin Atama ve Yer Değiştirmelerine İlişkin Yönetmelik. [Regulation on Appointment and Relocation of Educational Institutions Administrators.] (2009, Ağustos 3). Resmi Gazete (Sayı 27318). https://www.resmigazete.gov.tr/eskiler/2009/08/20090813-2.htm
• Mohan, V., Chauhan, S.P., & Chauhan, D. (2001). Are you aware how your personality effects your behavior? Global Business Review, 2(2), 289 304. https://doi.org/10.1177/097215090100200209
• Murillo, P. (2011). Human capital obsolescence: some evidence for Spain, International Journal of Manpower, 32(4), 426-445. https://doi.org/10.1108/01437721111148540
• Pazy, A. (1994). Cognitive Schemata of Professional Obsolescence, Human Relations, 47(10), 1167.
• Pazy, A. (1996). Concept and career-stage differentiation in obsolescence research. Journal of Organizational Behavior, 17(1), 59-78.
• Rothman, R.A., & Perrucci, R. (1971). Vulnerability to Knowledge Obsolescence: Among Professinals, The Sociological Quarterly, 12, 147-138.
• Shaffer, J. D. (1969). On institutional obsolescence and innovation- Background for Professional dialogue on public policy. American Journal of Agricultureal Economics, 51(2), 245-267.
• Shearer, R., & Steger, J. A. (1975). Manpower Obsolescence: A New Definition and Emprical Investigation of Personal Variables, Academy of Managment Journal, 18, 263- 275.
• Sorensen, J. B., & Stuart, T. E. (2000). Aging, obsolescence, and organizational innovation. Administrative Science Quarterly, 45(1), 81-112.
• Tan, Ş. (2009). Misuses of KR-20 and Cronbach’s alpha reliability coefficients. Journal of Education and Science, 34(152), 101-112.
• Tang, K. (1996). Polytomous Item Response Theory (IRT) Models and Their Applications in Large-Scale Testing Programs: Review of Literature. Educational Testing Service.
• Todman, J., & Dugard, P. (2007). Approaching multivariate statistics: an introduction for psychology. Psychology Press.
• Toner, P. (2011), Workforce Skills and Innovation: An Overview of Major Themes in the Literature, OECD Science, Technology and Industry Working Papers, 2011/1. OECD Publishing. https://doi.org/10.1787/5kgkdgdkc8tl-en
• van Loo, J., Grip, A., & Steur, M. (2001). Skills obsolescence: causes and cures. International Journal of Manpower, 22(1/2), 121-138.
• Wandera, D. B. (2014). The threat of obsolescence: teaching and learning responding to technology. Technology, Pedagogy and Education, 24(2), 279 281. https://doi.org/10.1080/1475939X.2014.913533
• Warmington, A. (1974). Obsolescence As An Organızational Phenomenon, The Journal of Management Studies, 11 (2), 96-114.
• Yürekli, H. (2010). The Relationship Between Parameters from Some Polytomous Item Response Theory Models. (Unpublished Master Thesis). The Florida State University, USA. http://purl.flvc.org/fsu/fd/FSU_migr_etd-1104