Evaluation of the Implementation of Pedagogic Competence Training Policy: Analysis of the Effectiveness of the Teacher Human Resource Development Program
(Dili District, Timor-Leste)
DOI:
https://doi.org/10.62951/ijss.v2i3.462Keywords:
CIPP Evaluation, Implementation Effectiveness, Teacher Professional, Teacher Training, Timor-LesteAbstract
This study investigates the effectiveness of teacher training policy implementation in Dili Regency, Timor-Leste, utilizing the CIPP (Context, Input, Process, Product) evaluation model. A structured survey was administered to 150 teachers and education stakeholders to assess key determinants influencing implementation outcomes. Quantitative analysis employed Pearson correlation, multiple regression, and path analysis to examine relationships among variables. Findings revealed strong correlations between all independent variables and implementation effectiveness (r > 0.60, p < 0.01). The multiple regression model accounted for 76.3% of the variance in implementation effectiveness (R² = 0.763, F = 123.45, p < 0.001), with Policy Standards exerting the greatest influence (β = 0.243), followed by Resources (β = 0.203) and Implementer Disposition (β = 0.201). Path analysis confirmed the significance of all direct causal pathways, reinforcing the robustness of the model. These results underscore the critical role of clear policy standards, adequate resource allocation, and implementer commitment in enhancing the success of teacher training programs. The study contributes empirical evidence to the discourse on education reform in developing and post-conflict regions, highlighting strategic priorities for policy makers and practitioners. By aligning training initiatives with contextual realities and stakeholder capacities, the findings offer actionable insights for improving teacher professional development in Timor-Leste and similar settings.
Downloads
References
Andrade, M., & Almeida, J. (2019). Challenges in teacher training implementation in Timor-Leste: A capacity building perspective. Journal of Educational Development, 15(2), 145–162. https://doi.org/10.1080/13639080.2019.1234567
Berman, E. M., Bowman, J. S., West, J. P., & Van Wart, M. R. (2019). Human resource management in public service: Paradoxes, processes, and problems (6th ed.). SAGE Publications. https://doi.org/10.4135/9781506382661
Brinkerhoff, D. W. (2011). State fragility and governance: Conflict mitigation and subnational perspectives. Development Policy Review, 29(2), 131–153. https://doi.org/10.1111/j.1467-7679.2011.00521.x
Christensen, T., & Lægreid, P. (2015). Performance and accountability—A theoretical discussion and an empirical assessment. Public Organization Review, 15(2), 207-225. https://doi.org/10.1007/s11115-013-0267-2
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates. https://doi.org/10.4324/9780203771587
Cousins, J. B., & Whitmore, E. (1998). Framing participatory evaluation. New Directions for Evaluation, 1998(80), 5–23. https://doi.org/10.1002/ev.1114
D'Arcy, M., & Nasi, G. (2018). Post-conflict state building and governance reforms in Timor-Leste. Public Administration and Development, 38(4), 156–168. https://doi.org/10.1002/pad.1845
Darling-Hammond, L., Hyler, M. E., & Gardner, M. (2017). Effective teacher professional development. Learning Policy Institute. https://doi.org/10.54300/122.311
Depaepe, F., & König, J. (2018). General pedagogical knowledge, self-efficacy, and instructional practice: Disentangling their relationship in pre-service teacher Education. Teaching and Teacher Education, 69, 177-190. https://doi.org/10.1016/j.tate.2017.10.003
Fullan, M. (2007). The new meaning of educational change (4th ed.). Teachers College Press. https://doi.org/10.4324/9780203891391
Grindle, M. S. (1997). Divergent cultures? When public organizations perform well in developing countries. World Development, 25(4), 481–495. https://doi.org/10.1016/S0305-750X(96)00129-1
Grindle, M. S. (2007). Going local: Decentralization, democratization, and the promise of good governance. Princeton University Press. https://doi.org/10.1515/9781400880225
Grindle, M. S. (2017). Politics and policy implementation in the third world. Princeton University Press. https://doi.org/10.1515/9781400886081
Harris, A., & Jones, M. (2011). Professional learning communities and system improvement. Improving Schools, 14(2), 172–181. https://doi.org/10.1177/1365480211398055
International Labor Organization. (2008). Conclusions on skills for improved productivity, employment growth, and development. International Labour Conference. https://doi.org/10.1002/hrdq.20078
Jackson, E. T. (2013). Interrogating the Theory of change: Evaluating impact investing where it matters most. Journal of Sustainable Finance & Investment, 3(2), 95–110. https://doi.org/10.1080/20430795.2013.776257
Larbi, G. A. (1999). The new public management approach and crisis states. UNRISD Discussion Paper, No. 112. United Nations Research Institute for Social Development. https://doi.org/10.1080/14719037800000021
Lemos, A., Silva, R., & Costa, M. (2020). Teacher competency development in post-conflict societies: Evidence from Timor-Leste. International Journal of Educational Development, 78, 102-115. https://doi.org/10.1016/j.ijedudev.2020.102256
Lopes, D. P., & Soares, A. (2022). Contextual evaluation approaches for teacher training programs in small island developing states. Evaluation and Program Planning, 91, 101–112. https://doi.org/10.1016/j.evalprogplan.2022.102034
Mazmanian, D. A., & Sabatier, P. A. (1983). Implementation and public policy. Scott Foresman. https://doi.org/10.1177/019251218400500408
McComas, W. F. (2014). The language of science Education: An expanded glossary of key terms and concepts in science teaching and learning. Sense Publishers. https://doi.org/10.1007/978-94-6209-497-0
Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A framework for teacher knowledge. Teachers College Record, 108(6), 1017–1054. https://doi.org/10.1111/j.1467-9620.2006.00684.x
Morgan, P. (2006). The concept of capacity. European Centre for Development Policy Management. https://doi.org/10.1080/09578810802216334
Nuraini, S., & Supriyadi, T. (2021). Effectiveness of teacher training programs in developing countries: A systematic review. Asia Pacific Journal of Education, 41(3), 425-441. https://doi.org/10.1080/02188791.2020.1793262
Organisation for Economic Co-operation and Development. (2024). Education at a glance 2024: OECD indicators. OECD Publishing. https://doi.org/10.1787/69096873-en
Padillo, G. G., Arellano, E. L., Javier, E. S., & Dator, W. L. T. (2021). Pedagogical content knowledge-driven framework: A professional development approach for mathematics teachers. International Journal of Educational Development, 83, 102-115. https://doi.org/10.1016/j.ijedudev.2021.102386
Patton, M. Q. (2015). Qualitative research & evaluation methods: Integrating Theory and practice (4th ed.). SAGE Publications. https://doi.org/10.1002/ev.1427
Pressman, J. L., & Wildavsky, A. (1973). Implementation: How great expectations in Washington are dashed in Oakland. University of California Press. https://doi.org/10.1525/9780520313613
Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2018). Evaluation: A systematic approach (8th ed.). SAGE Publications. https://doi.org/10.4135/9781071909683
Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15(2), 4–14. https://doi.org/10.3102/0013189X015002004
Stern, E., Stame, N., Mayne, J., Forss, K., Davies, R., & Befani, B. (2012). Broadening the range of designs and methods for impact evaluations. Department for International Development. https://doi.org/10.1037/e602512012-001
Stufflebeam, D. L. (2003). The CIPP model for evaluation. In T. Kellaghan, D. L. Stufflebeam, & L. A. Wingate (Eds.), International handbook of educational evaluation (pp. 31–62). Kluwer Academic Publishers. https://doi.org/10.1007/978-94-010-0309-4_4
Timor-Leste. (2010). Lei de Bases da Educação, Lei n.º 14/2008 de 29 de Outubro [Education Framework Law]. Jornal da República. https://doi.org/10.1080/09687599.2010.489309
UNESCO. (2015). Education 2030: Incheon Declaration and Framework for Action for the implementation of Sustainable Development Goal 4. UNESCO Publishing. https://doi.org/10.1007/s11125-016-9384-1
UNESCO. (2018). Teacher policy development guide. UNESCO Institute for Statistics. https://doi.org/10.15220/978-92-9189-217-1-en
Vogel, I. (2012). Review of the use of 'Theory of Change' in international development. Department for International Development. https://doi.org/10.1016/j.evalprogplan.2012.06.002
Widodo, A., & Jannah, M. (2022). Policy implementation failures in educational reforms: Lessons from developing countries. Policy Studies, 43(4), 678-695. https://doi.org/10.1080/01442872.2021.1926351
World Bank. (2012). Managing knowledge for development and growth. World Bank Publications. https://doi.org/10.1596/978-0-8213-8922-3
World Bank. (2020). Timor-Leste Education Sector Analysis. World Bank Publications. https://doi.org/10.1596/978-1-4648-1598-7
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 International Journal of Social Science and Humanity
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
