HomePsychology and Education: A Multidisciplinary Journalvol. 5 no. 12 (2022)

Modelling SMEA Implementation: The Implementers’ Perspectives

Jerelyn R. Amigo | Betelino V. Amigo

Discipline: Education

 

Abstract:

The challenges of school monitoring and evaluation (M&E) implementation and the scarcity of literature discussing factors of successful SMEA implementation prompted this initiative to devise a model illustrating how SMEA factors were directly influencing the efficiency of school improvement processes. Using a sequential exploratory design to generate indicators and components of SMEA from the implementers’ perspective, an exploratory factor analysis (EFA) was utilized to extract and group the factors to determine the emerging components. Cronbach's alpha was used to assess the reliability of the instrument. The model depicting interrelationship among SMEA components was costumed fit using a structural equation modeling and was interpreted using Cohen’s effect size strength of association. Five factors derived from varying perspectives of SMEA implementation were extracted and were categorized as (1) the implementers’ appreciation of SMEA benefits, (2) school engagement towards good SMEA practices, (3) SMEA’s support to quality instruction, (4) SMEA challenges and limitations, and (5) knowledge and skills of SMEA implementers. Among these, four components emerged as significantly interrelated and were contributory to successful SMEA implementation. This strength of positive correlation was illustrated in a model which described how the implementers’ appreciation of SMEA benefits supported the enhanced appraisal of the quality of the teaching and learning process. Hence, extensive research is recommended for deepening each component to sustain and refine the system.



References:

  1. Abdourahmane, B. (2021). How to measure monitoring and evaluation effectiveness? ResearchGate. African Evaluation Journal. R e t r i e v e d f r o m https://www.researchgate.net/journal/African-EvaluationVol9(No 1 | a553) DOI:10.4102/aej.v9i1.553
  2. Adaletey, E. J. & George, T. J. (2019). The Relevance of Monitoring, Supervision and Evaluation of Stakeholder Participation in Electronic Governance Projects Implemented in Public Sector Institutions: A Review of Literature. Journal of Humanities and Social Science (IOSR-JHSS) Volume, 24, pp. 52-60.
  3. Ann W. Frye & Paul A. Hemmer (2012) Program evaluation models and related theories: AMEE Guide No. 67, Medical Teacher, 34:5, e288-e299, DOI: 10.3109/0142159X.2012.668637
  4. Aziz, S. (2021). Implementation of CIPP Model for Quality Evaluation at School Level: A Case Study. Retrieved from EJ1180614.pdf (ed.gov) on September 10, 2021
  5. Bajaj, et al (2018). Total quality management: a critical literature rev iew u sing Pareto an aly si s. R et riev ed from h t t p s : / / w w w . e m e r a l d . c o m / insight/content/doi/10.1108/IJPPM-07-2016-0146/ on September 11, 2021.
  6. BrckaLorenz, A. (2017). Internal Consistency Reliability. Thousand Oaks, CA: Sage Publications, Inc. Retrieved from https://www.semanticscholar.org/paper/Internal-Consistency-Reliabi lity-Shuttleworth/6bd8727ad21790a48341349603ac8531b08a81b4
  7. Cavanaugh, C., McCarthy, A., & East, M. (2014). An innovation framework for holistic school transformation: ten critical conversations for the 21st century. Redmond, WA: Microsoft World Public Sector.
  8. Curray, D. (2019). Perspective on Monitoring and Evaluation. V o l u m e : 40 i s s u e : 1 , p a g e ( s ) : 1 4 7 - 1 5 0 . doi https://doi.org/10.1177 /1098214018775845
  9. Day, C. and Sammons, P. 2019. Successful school leadership. Retrieved from https://files.eric.ed.gov/fulltext/ED565740.pdf on September 4, 2021
  10. Edmund, S. (2012). Designing monitoring and evaluation systems in PEPs. Switzerland. ILO Publications (Rights and Permissions), International Labour Office, CH-1211 Geneva 22, Switzerland. ISBN 9789221267713; 9789221267720.
  11. Elacqua and Alves, (2015). Designing effective monitoring and evaluation of education systems for 2030: A global synthesis of policies and practices UNESCO Education Sector Division for Policies and Lifelong Learning Systems (ED/PLS) Section of Education Policy (ED/PLS/EDP. Retrieved on June 22, 2022 from http://designing_effective_monitoring_and_evaluation_of_education_systems_for_2030_a_global_synthesiss_of_policies_and_practices_unesco_education_sector_division_for_policies_and_lifelong_learning_systems_ed_pls_section_of_education_policy_ed_pls_edp./
  12. Hair, et al (2019). Revisiting Hair Et al.’s Multivariate Data Analysis: 40 Years Later. DOI: 10.1007/978-3-030-06031-2_15
  13. Holvoet, N. (2014). Taking stock of monitoring and evaluation systems in the health sector: findings from Rwanda and Uganda. 29(4):506-16. doi: 10.1093/heapol/czt038
  14. Kusek and Rist, (2004). Ten steps to a results-based monitoring and evaluation system: A handbook for Development Practitioners.
  15. R e t r i e v e d o n J u n e 2 5 , 2 0 2 2 athttps://books.google.com.ph/books?hl=en&lr=&id=AN1_ UBu0k1cC&oi=fnd&pg=PR1&dq=Kusek+and+Rist+2004+monitor i n g + a n d + e v a l u a t i o n + r e s e a r c h & o t s = P 1 G q q q T - V Q & s i g = 2 y 9 b k l e j Y f c Y g 3 g - E N 6 j M h 1 1 y z g & redir_esc=y#v=onepage&q=Kusek%20and%20Rist%202004%20m onitoring%20and%20evaluation%20research&f=false.
  16. Kyriakides. L. (2010). Using the Dynamic Model to develop an evidence-based and theory-driven approach to school improvement. R e t r i e v e d from https://www.ucy.ac.cy/esf/documents/data/esf/Publications/using_the_dynamic_model.pdf on July 26, 2021
  17. Khurniawan et al., 2021. The Collaborative Strategy of Total Quality management and School Governance to Improving Effectiveness of Vocational School-Based Enterprise. Retrieved f r o m h t t p s % 3 A % 2 F % 2 F w w w . r e s e a r c h g a t e . net%2Fpublication%2F350175589_The_Strategy_Improving_Schoo l - B a s e d _Enterprise_An_Analytic_Hierarchy_Process_Approach_In_Vocati onal_School_ Palarch%27s on September 8, 2021
  18. LLantos, M. & Pamatpat, F. 2016. Total Quality Management and School-Based Management Practices of School Principals: Their Implications to School Leadership and Improvement. Retrieved f r o m https://www.researchgate.net/publication/327665248TotalQuality on August 10, 2021
  19. OECD Chapter 8 Education system evaluation: Informing policies for system improvement
  20. OECD 2019. Evaluation and Assessment Frameworks for Improving School Outcomes. Retrieved from 46927511.pdf (oecd.org) on July 3, 2021
  21. Madzimure and Mashishi, (2020). Evaluating the Significance of Strategic Management on the Monitoring and Evaluation of Secondary Schools in Gauteng Province, South Africa. h t t p s : / / s c h o l a r . g o o g l e . c o m . p h /scholar?hl=en&as_sdt=0%2C5&as_vis=1&q=Madzimure+and+ma shishi%2C+2020+monitoring+and+evaluation+research&btnG=.
  22. Njama, A. (2015). Determinants of effectiveness of a monitoring and evaluation system for projects: A case of Amrep Kenya Wash P r o g ra mm e. R et riev ed on June 21, 2022 ,from http://erepository.uonbi.ac.ke//bitstream/handle/11295/92952/Njama,%20Amos%20W_Determinants%20of%20effectiveness%20of%20a%20monitoring%20and%20evaluation%20system%20for%20projects,%20%20a%20case%20of%20AMREF%20Kenya%20wash%20programme.pdf?sequence=3.
  23. Paragoso, S. & Barazon, L. 2019. School Monitoring, Evaluation, and Adjustment (SMEA) in Central Cebu, Philippines. Retrieved from School Monitoring, Evaluation, and Adjustment (SMEA) in Central Cebu, Philippines | Semantic Scholar
  24. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in N u r s i n g & H e a l t h . 2 0 0 7 ; 3 0 ( 4 ) : 4 5 9 – 67. https://doi.org/10.1002/nur.20199
  25. Read, L. and Atinc, T. (2017). Investigations Into Using Data to Improve Learning: Philippines Case Study. Research Gate. Retrieved from (PDF) Investigations into Using Data to Improve Learning: Philippines Case Study (researchgate.net)
  26. UNESCO, (2018). Designing effective monitoring and evaluation of education systems for 2030: A global synthesis of policies and practices UNESCO Education Sector Division for Policies and Lifelong Learning Systems (ED/PLS) Section of Education Policy ( E D / P L S / E D P . R et rie v ed June 14, 2 022 , from https://www.academia.edu/34653270/Designing_effective_monitoring_and_evaluation_of_education_systems_for_2030_A_global_synthesiss_of_policies_and_practices_UNESCO_Education_Sector_Division_for_Policies_and_Lifelong_Learning_Systems_ED_PLS_Sect ion_of_Education_Policy_ED_PLS_EDP.
  27. UNESCO, (2015). Education for Al Global Monitoring Report 2015. R e t r i e v e d o n J u n e 1 6 , 2 0 2 2 , from https://reliefweb.int/report/world/education-all-global-monitoring-report-2015-education-all-2000-2015-achievements.
  28. Yusoff, M. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal. 2019;11(2):49–54. https://doi.org/10.21315/eimj2019.11.2.6