Scale Development and Validation of Leadership and Management Practices at Isabela State University
Keywords:
exploratory factor analysis; higher education leadership; management practices; scale development; institutional governanceAbstract
This study developed and examined the preliminary validity of the Leadership and Management Practices Scale for Isabela State University. Using a cross-sectional scale-development design, data were collected from 239 full-time faculty members across different colleges and campuses. The initial instrument contained 80 items rated on a five-point Likert scale. Exploratory factor analysis was conducted through principal-axis factoring with Promax rotation, while parallel analysis was used to determine the number of factors. The data were suitable for factor analysis, with a Kaiser–Meyer–Olkin value of 0.912 and a significant Bartlett’s test of sphericity, χ²(3160) = 32,291.21, p < .001. Six factors were retained, explaining 76.51% of the total variance. After applying the criteria for factor loading, cross-loading, and communality, 48 items were retained. The factors were labeled Supportive and Performance-Oriented Management, Strategic Leadership and Faculty Development, Policy Governance and Institutional Support, Participatory and Equitable Administration, Faculty Networking and Role Balance, and Student-Centered Teaching Innovation. Reliability estimates ranged from 0.878 to 0.971. The findings provide initial support for a multidimensional measure of university leadership and management practices. Further item development and confirmatory factor analysis using an independent sample are recommended before the scale is used for high-stakes institutional assessment.
References
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Educational Research Association.
Arwin, A., Kenedi, A. K., Anita, Y., Hamimah, & Zainil, M. (2024). STEM-based digital disaster learning model for disaster adaptation ability of elementary school students. International Journal of Evaluation and Research in Education (IJERE), 13(5), 3248-3259. https://doi.org/10.11591/ijere.v13i5.29616
Bass, B. M. (1985). Leadership and performance beyond expectations. Free Press.
Birnbaum, R. (1988). How colleges work: The cybernetics of academic organization and leadership. Jossey-Bass.
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, Article 149. https://doi.org/10.3389/fpubh.2018.00149
Burns, J. M. (1978). Leadership. Harper & Row.
Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319. https://doi.org/10.1037/1040-3590.7.3.309
Clark, L. A., & Watson, D. (2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412–1427. https://doi.org/10.1037/pas0000626
Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10, Article 7. https://doi.org/10.7275/jyj1-4868
de Winter, J. C. F., Dodou, D., & Wieringa, P. A. (2009). Exploratory factor analysis with small sample sizes. Multivariate Behavioral Research, 44(2), 147–181. https://doi.org/10.1080/00273170902794206
Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412. https://doi.org/10.1111/bjop.12046
Eisinga, R., te Grotenhuis, M., & Pelzer, B. (2013). The reliability of a two-item scale: Pearson, Cronbach, or Spearman–Brown? International Journal of Public Health, 58(4), 637–642. https://doi.org/10.1007/s00038-012-0416-3
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272
Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466–491. https://doi.org/10.1037/1082-989X.9.4.466
Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7(3), 286–299. https://doi.org/10.1037/1040-3590.7.3.286
Garrido, L. E., Abad, F. J., & Ponsoda, V. (2013). A new look at Horn’s parallel analysis with ordinal variables. Psychological Methods, 18(4), 454–474. https://doi.org/10.1037/a0030005
Global Education Monitoring Report Team. (2024). 2024/5 Global Education Monitoring Report: Leadership in education—Lead for learning. UNESCO.
Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7(2), 191–205. https://doi.org/10.1177/1094428104263675
Hiltrimartin, C., Afifah, A., Pratiwi, W. D., & Rahman, M. A. (2024). Analyzing Students’ Thinking in Mathematical Problem Solving Using Vygotskian Sociocultural Theory. Revista de Gestão Social e Ambiental, 18(1), e04802-e04802. https://doi.org/10.24857/rgsa.v18n1-105
Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1(1), 104–121. https://doi.org/10.1177/109442819800100106
Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/BF02289447
Howard, M. C. (2016). A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve? International Journal of Human–Computer Interaction, 32(1), 51–62. https://doi.org/10.1080/10447318.2015.1087664
Jusoh, A. J., Imami, M. K. W., Isa, A. N. M., Omar, S. Z., Abdullah, A., & Wahab, S. (2023). Verification the reliability and validity of a Malaysian version of rathus assertiveness schedule as drug prevention scale. Islamic Guidance and Counseling Journal, 6(2). https://doi.org/10.25217/0020236369700
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). Exploratory item factor analysis: A practical guide revised and updated. Anales de Psicología, 30(3), 1151–1169. https://doi.org/10.6018/analesps.30.3.199361
MacCallum, R. C., Widaman, K. F., Preacher, K. J., & Hong, S. (2001). Sample size in factor analysis: The role of model error. Multivariate Behavioral Research, 36(4), 611–637. https://doi.org/10.1207/S15327906MBR3604_06
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84–99. https://doi.org/10.1037/1082-989X.4.1.84
McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144
Matt, D. G. F., Banseng, S., & Gerry, D. (2022). Effect of wordwall in teaching malay literature component amongst form one students. International Journal of Education, Technology and Science, 2(3), 279-287.
Mundfrom, D. J., Shaw, D. G., & Ke, T. L. (2005). Minimum sample size recommendations for conducting factor analyses. International Journal of Testing, 5(2), 159–168. https://doi.org/10.1207/S15327574IJT0502_4
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 396–402. https://doi.org/10.3758/BF03200807
Ramsden, P. (1998). Learning to lead in higher education. Routledge.
Schmitt, T. A. (2011). Current methodological considerations in exploratory and confirmatory factor analysis. Journal of Psychoeducational Assessment, 29(4), 304–321. https://doi.org/10.1177/0734282911406653
Setiawati, S., & Defi, T. A. C. (2025). Pendidikan keluarga di era digital (Family education in the digital era). PT Mafy Media Literasi Indonesia.
Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74(1), 107–120. https://doi.org/10.1007/s11336-008-9101-0
Solfema, S., Sunarti, V., & Rahman, M. A. (2024). Prinsip-prinsip andragogi dalam pelatihan orang dewasa (Principles of andragogy in adult training). Rajawali Pers.
Spillane, J. P. (2006). Distributed leadership. Jossey-Bass.
Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246. https://doi.org/10.1177/0095798418771807
Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. https://doi.org/10.1177/0011000006288127
Zainil, M., Kenedi, A. K., Rahmatina, & Indrawati, T. (2024). The influence of STEM-based digital learning on 6C skills of elementary school students. Open Education Studies, 6(1), 20240039. https://doi.org/10.1515/edu-2024-0039
Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432–442. https://doi.org/10.1037/0033-2909.99.3.432
Published
Issue
Section
License
Copyright (c) 2026 Eugelyn R. Felix (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
