Enriching Program Evaluation Utilization in Selected Chartered Christian Kenyan Universities through Human Resource Management and Development
Higher education in Africa has marked a rise not only in the number of institutions, academic programs and students, but also in monitoring and evaluation of its processes and products. However, there is still scanty evidence of whether or how the evaluation results are used and what factors affect their use or non-use. The researcher adopted the quantitative correlation design to study associations between human factors and the use or non-use of PE results in selected Chartered Christian Universities (CCUs) in Kenya. A population census of program leaders of 50 accredited, operational and re-evaluated academic programs in three CCUs was conducted. A questionnaire was used for data collection. Descriptive and inferential analysis was done. Pearson Chi-square and Cramer’s V tests were used to determine the association between faculty and staff evaluation skills, involvement in program evaluation process, and commitment to use the evaluation results (independent variables) and use or non-use of program evaluation results (dependent variable). The findings revealed that evaluators’ and users’ evaluation skills, involvement and commitment to use the results had a moderate, positive and statistically significant correlation with the use or non-use of evaluation results to modify a component of the program. This was shown by ?2 (1df) =6.549a, p -value =.010 and Cramer’s V of .400 (p=.010) for the level of faculty and staff evaluation skills; ?2 (1df) =8.168a, p -value = .004 and Cramer’s V of .446 (p=.004) for faculty and staff involvement in PE evaluation process; and by ?2 (1df) =5.373a , p -value = .020 and Cramer’s V of .362 (p = .020) for faculty and staff commitment to use the evaluation results. The findings suggest that when the level of faculty and staff evaluation skills, involvement and commitment to use the results is high, the use of evaluation results is likely to increase. The researcher therefore recommends enactment of institutional policies and evaluation practices that will increase faculty and staff level of evaluation skills, participation in the evaluation process, and commitment to use evaluation results, since these human factors tend to enhance the use of evaluation results.
Keywords: Program evaluation, evaluation use, evaluation human factors, evaluation capacity, quality education, higher education, Christian universities.
Bennett, J. (2003). Evaluation Methods in Research. London: Continuum.
Chacha Nyaigotti-Chacha. (2017). Press Statement on Quality Audit of Universities in Kenya Conducted In January And February 2017. http://host.nationmedia.com/CUE-uni.pdf.
Christie, Christina & Alkin, Marvin. (2013). An Evaluation Theory Tree - 2012 (most updated version). https://www.researchgate.net/publication/333392751_AN_EVALUATION_THEORY
Commission for Higher Education, (2008). Handbook on Processes for Quality Assurance in Higher Education in Kenya. http://www.cue.or.ke.
Cousins, J. Bradley and Whitmore, Elizabeth. (1988). Framing Participatory Evaluation. In New Directions for Evaluation. Winter 1998, Vol. 80. Jossey-Bass Publishers. https://doi.org/10.1002/ev.1114.
Eisner, E. W. (1979). The Educational Imagination: On the Design and Evaluation of School Programs. New York: MacMillan Publishing Co. Inc.
Hayward, F. (2006). Quality assurance and accreditation of higher education in Africa. Paper prepared for presentation at the Conference on Higher Education Reform in Francophone Africa: Understanding the Keys of Success. June 13-15, Ouagadougou, Burkina Faso.
Hogan, R. Lance. (2007). The Historical Development of Program Evaluation: Exploring The Past And Present. Online Journal of Workforce Education and Development, 2(4),– Fall 2007.
Kabuye, J. & Basheka, B.C., (2017). ‘Institutional design and utilisation of evaluation results in Uganda’s public universities: Empirical findings from Kyambogo University’, African Evaluation Journal 5(1), a190. https://doi.org/10.4102/aej. v5i1.190.
Kabuye, James. (2016). Institutional Design and Utilisation of Evaluation Results In Uganda`S Public Universities: A Case Study of Kyambogo University. Dissertation. Uganda Technology and Management University (Utamu).
Leahy, M.J., Thielsen, V.A., Millington, M.J., Austin, B., & Fleming, A. (2009). Quality assurance and program evaluation: Terms, models, and applications. Journal of Rehabilitation Administration, 33(2), 69-82.
Maloney, J. (2017) ‘Evaluation: What’s the Use?’ Evaluation Journal of Australasia, 17(4), pp. 25–38. doi: 10.1177/1035719X1701700404. https://journals.sagepub.com/doi/10.1177/1035719X1701700404.
Materu Peter. (2007). Higher Education Quality Assurance in Sub-Saharan Africa: Status, Challenges, Opportunities, and Promising Practices. Washington, D.C: The World Bank.
McDavid James C. Huse Irene and Ingleson Laura R. L. (2013). Program Evaluation and Performance Measurement: An Introduction to Practice. 2nd Edition, Canada, SAGE Publications Inc.
Mukhwana, E., S. Oure, S. Kiptoo, A. Kande, R. Njue, J. Too and D.K. Some. (2016). State of University Education in Kenya. Commission for University Education. Discussion. Paper 04. Nairobi, Kenya.
Myhlhousen-Leak, Georgetta Ann Daisy. (2011). "An investigation of outcomes assessment utilization in the context of teacher education program accreditation." PhD (Doctor of Philosophy) thesis, University of Iowa. https://ir.uiowa.edu/etd/1037.
Okebukola Peter A. and Fonteyne Bart (2014). Developing a Pan-African Quality Assurance and Accreditation Framework.
Otunga Ruth N with Isaac I. Odero and Peter L. Barasa. (2011). A Handbook for Curriculum and Instruction. Eldoret: Moi University Press.
Palomba, Catherine A. and Banta, Trudy W. (1999). Assessment Essentials: Planning, Implementing, and Improving Assessment in Higher Education, 1st ed. San Francisco: Jossey-Bass Publishers.
Patton M. Q. (2008). Utilization focused Evaluation. (4th ed.). Thousand Oaks, CA: Sage.
Peck, L., & Gorzalski, L. (2009). An Evaluation Use Framework and Empirical Assessment. Journal of MultiDisciplinary Evaluation, 6(12), 139-156. Retrieved from https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/228.
Phillips, D. C. (2018). The many functions of evaluation in education. Education Policy Analysis Archives, 26(46). http://dx.doi.org/10.14507/epaa.26.3811 This article is part of the Special Issue, Historical and Contemporary Perspectives on Educational Evaluation: Dialogues with the International Academy of Education, guest edited by Lorin W. Anderson, Maria de Ibarrola, and D. C. Phillips.
Sawer, Barbara J. (1992). Evaluating for Accountability: A Practical Guide for the Inexperienced Evaluator. Oregon State University Extension Service.
Stufflebeam, Daniel L. (1968). Evaluation as Enlightenment for Decision-Making. An Address Delivered at the World’s Conference on Assessment Theory. Sponsored by The Commission on Assessment of Educational Outcomes. The Association for Supervision and Curriculum Development. Sarasota, Florida.
Stufflebeam, Daniel L. (2001). Evaluation Models. New Directions for Evaluation, no. 89, Spring 2001 © Jossey-Bass, A Publishing Unit of John Wiley & Sons, Inc.
Sujitparapitaya, S. (2014). “Achieving faculty buy-in: motivation performance in learning outcome assessment. Journal of Case Studies in Accreditation and Assessment, Vol. 3, (February 2014, pp. 1-22).
Taut, S., & Alkin, M. C. (2003). Program Staff Perceptions of Barriers to Evaluation Implementation. In American Journal of Evaluation, 24( 2), 213–226.
Teferra, Damtew and Altbach, Philip G. (2003). “Trends and Perspectives in African Higher Education” In African Higher Education: An International Reference Handbook. Edited by Damtew Teferra and Philip G. Altbach. Indianapolis, Indiana University Press.
UNESCO Education Sector. (2016). Designing effective monitoring and evaluation of education systems for 2030: A global synthesiss of policies and practices.
Welsh, John F. and Metcalf, Jeff. (2003). Cultivating Faculty Support for Institutional Effectiveness Activities: benchmarking best practices. Assessment & Evaluation in Higher Education, Vol. 28, No. 1. Carfax Publishing. Taylor and Group.