Email this article Pedagogy Evaluations by Indonesian Teachers Implementing Quality Teaching Rounds: An Initial Exploratory Qualitative Study
Abstract
Abstract: Pedagogy Evaluations by Indonesian Teachers Implementing Quality Teaching Rounds: An Initial Exploratory Qualitative Study. Objectives: QTR research in Indonesia has been limited to experimental research on selected aspects of the program. This preliminary study in a qualitative explanatory sequence aimed to describe Indonesian teachers’ individual pedagogy evaluations during a high-fidelity application of the Quality Teaching Rounds (QTR) program, using comparisons with expert evaluations. A deductive, “top-down” approach to theme-finding provided hard data in this under-researched area, to be further investigated in later studies. Methods: Eight teachers from two schools were recruited to implement QTR. In school-based professional learning communities, teachers observed lessons, used the Quality Teaching Model to assign kodes (evaluations) to pedagogy using ‘Koding Sheets’, then discussed their kodes. Koding Sheets were collected as primary data, and teacher initial kodes verified using discussion transcripts. Expert evaluations were created by an Australian internal expert using Quality Teaching Model rubrics, observation notes and consultations with Indonesian educators and an external expert. Koding Sheets were collated and colour-coded as ‘the same’, ‘higher’, or ‘lower’ than expert kodes. Frequencies were tabulated using Excel to find overarching themes or patterns addressing the research question. Findings: Themes included: (1) Dissimilarity of teacher kodes to expert kodes; (2) Prevalence of overestimating in kodes; (3) Trends of ‘same’ kodes increased for many and decreased for some; and (4) professional learning community-based differences in trends and counts. Results suggest social constructionism explains teacher learning leading to evaluation patterns, as well as the presence and influence of language, cultural, school contextual, relational factors on teacher pedagogy evaluations. Conclusion: Recommended research is outlined to confirm, identify, measure and determine how to mitigate these factors, to enable recommendations as to the suitability of QTR with the Indonesian context.
Keywords: evaluation, indonesian teachers, pedagogy evaluation, qualitative exploratory method, quality teaching rounds.
DOI: http://dx.doi.org/10.23960/jpp.v14.i3.2024101
Full Text:
PDFReferences
Amadhannn, A. (24 March 2023). Map of western indonesia. Wikimedia commons. [Image]. Retrieved from: https://commons.wikimedia.org/w/index.php?curid=129942483 Accessed 25 September 2024.
Amosa, W., Ladwig, J., Griffiths, T., & Gore, J. (2007). Equity effects of Quality Teaching: Closing the gap. Paper presented at the Australian Association for Research in Education conference, Fremantle. Retrieved from: https://www.aare.edu.au/data/publications/2007/amo07284.pdf
Anwar, A., Harun, C. Z, dan Niswanto, N. (2022). Academic supervision of the school principal in improving the performance of elementary teachers in clusters i-ii in bandar dua, pidie jaya district, indonesia. Traektoriâ Nauki = Path of Science, 8(12), 4042-4050. Retrieved from: https://doi.org/10.22178/pos.88-13
Aruan, C. D. (2015). Hrm reform in the indonesian civil service: towards strategic fit? 2nd Global Conference on Business and Social Science-2015, GCBSS-2015, 17-18 September 2015. Bali: Elsevier. Procedia - Social and Behavioral Sciences, 211(2015): 49–54. Retrieved from: https://doi.org/10.1016/j.sbspro.2015.11.008
Australian Bureau of Statistics. (no date). Quantitative and Qualitative data. ABS Website. Retrieved from: https://www.abs.gov.au/statistics/understanding-statistics/statistical-terms-and-concepts/quantitative-and-qualitative-data
Benedict, R. (2005). The chrysanthemum and the sword: patterns of japanese culture. 1st Mariner Books ed. Boston, Houghton Mifflin.
Bernard, H. R. (1994). Research methods in anthropology: qualitative and quantitative approaches, second edition. Walnut Creek: AltaMira Press.
Bloom, B., Englehart, M. Furst, E., Hill, W. & Krathwohl, D. (1956). Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. New York: Longmans, Green. Retrieved from: https://web.archive.org/web/20201212072520id_/https://www.uky.edu/~rsand1/china2018/texts/Bloom%20et%20al%20-Taxonomy%20of%20Educational%20Objectives.pdf
Bogdan, R. C. & Biklen, S. K. (1997). Qualitative research for education: an introduction to theory and methods. Needham Heights: Allyn & Bacon
Bryk, A. S. (2014). Improving: Joining improvement science to networked communities. Distinguished Lecture presented at the American Educational Research Association, Philadelphia, Pennsylvania. Retrieved from: http://convention2.allacademic.com/one/aera/aera14/index.php?cmd=Online+Program+View+Event&selected_box_id=165082&PHPSESSID=ehvpf2svmltu7u3dhvee8c9ul7
Darling-Hammond, L. (2013). Getting teacher evaluation right: What really matters for effectiveness and improvement. New York: Teachers College Press.
Djulete, W. (2021). The influence of professional learning communities employing quality teaching framework on English as a foreign language teachers’ pedagogical content knowledge for promotion of higher order thinking in rural Indonesia. [Dissertation Abstract]. Flinders University, College of Education, Psychology and Social Work. Retrieved from: https://theses.flinders.edu.au/view/f077bdf5-95eb-41ca-a805-a2473c33ed8f/1
Fereday, J. & Muir-Cochrane, E. (2006). Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. International Journal of Qualitative Methods, 5(1), 80-92. Retrieved from: https://doi.org/10.1177/160940690600500107
Harry Firman, H. & Tola, B. (2008). The future of schooling in indonesia. cice hiroshima university, Journal of International Cooperation in Education. 11(1): 71-84. Retrieved from: https://doi.org/10.15027/34287
George, T. (20 November, 2023). Exploratory research: definition, guide, & examples. Scribbr. Retrieved from: https://www.scribbr.com/methodology/exploratory-research/ (Accessed October 28, 2024).
Gore, J. M. (2007). Improving pedagogy: Challenges of moving teachers toward higher levels of Quality Teaching. In J. Butcher & J. Asha (Eds). Making a difference: Challenges for teachers, teaching, and teacher education (pp. 15–33). New York: Sense. Retrieved from: https://doi.org/10.1163/9789087901332_003
Gore, J. (2020). Why isn’t this empowering? The discursive positioning of teachers in efforts to improve teaching. In A. Brown & E. Wisby (eds.) Knowledge, policy and practice: The struggle for social justice in education (199-216). London, UK: UCL IOE Press.
Gore, J. M. & Bowe, J. M. (2015). Interrupting attrition? Re-shaping the transition from preservice to inservice teaching through Quality Teaching Rounds. International Journal of Educational Research, 73(2015), 77-88. Retrieved from: https://doi.org/10.1016/j.ijer.2015.05.006
Gore, J., Smith, M., Bowe, J., Ellis, H., Lloyd, A., & Lubans, D. (2015). Quality Teaching Rounds as a professional development intervention for enhancing the quality of teaching: Rationale and study protocol for a cluster randomised controlled trial. International Journal of Educational Research, 74(2015): 82–95. Retrieved from: https://doi.org/10.1016/j.ijer.2015.08.002
Gore, J., Lloyd, A., Smith, M., Bowe, J., Ellis, H., & Lubans, D. (2017). Effects of professional development on the quality of teaching: Results from a randomised controlled trial of Quality Teaching Rounds. Teaching and Teacher Education, 68(November 2017): 99–113. Retrieved from: https://doi.org/10.1016/j.tate.2017.08.007.
Gore, J. (2021). The quest for better teaching. Oxford Review of Education, 47(1): 45-60. Retrieved from: https://doi.org/10.1080/03054985.2020.1842182.
Gore, J., Miller, A., Fray, L., Harris, J., & Prieto, E. (2021). Improving student achievement through professional development: Results from a randomised controlled trial of Quality Teaching Rounds. Teaching and Teacher Education, 101(103297): 1-12. Retrieved from: https://doi.org/10.1016/j.tate.2021.103297
Gore, J. & Rickards, B. (2021). Rejuvenating experienced teachers through Quality Teaching Rounds professional development, Journal of Educational Change, 22(2021): 335-354. Retrieved from: https://doi.org/10.1007/s10833-020-09386-z.
Gore, J., Rickards, B. and Fray, L. (2023). From performative to professional accountability: re-imagining ‘the field of judgment’ through teacher professional development, Journal of Education Policy, 38(3): 452-473. Retrieved from: https://doi.org/10.1080/02680939.2022.2080274
Hattie, J. A. C. (2009). Visible Learning: A synthesis of over 800 meta-analyses relating to achievement. New York: Routledge.
Hattie, J. A. C. (2023). Visible learning: the sequel: a synthesis of over 2,100 meta-analyses relating to achievement. London: Routledge.
Houston, S. (2001). Beyond social constructionism: critical realism and social work. the british journal of social work. 31(6, December 2001), 845-861. Retrieved from: https://www.jstor.org/stable/23716466
Indrawati, S. M. & Kuncoro, A. (2021). Improving competitiveness through vocational and higher education: indonesia’s vision for human capital development in 2019–2024. Bulletin of Indonesian Economic Studies, 57(1, 2021), 29–59. ANU Indonesia Project. Routledge. Retrieved from: http://dx.doi.org/10.1080/00074918.2021.1909692
Jacobs, V. R., Lamb, L. L. C. & Philipp, R. A. (2010). Professional noticing of children's mathematical thinking. Journal for Research in Mathematics Education, 41(2, March 2010): 169-202. National Council of Teachers of Mathematics. Retrieved from: https://www.jstor.org/stable/20720130
Kennedy, M. M. (2016). How does professional development improve teaching? Review of Educational Research, 86(4): 945-980. American Educational Research Association. Retrieved from: https://www.jstor.org/stable/44668240
Krathwohl, D. R. (2002) A revision of bloom’s taxonomy. Theory into Practice. 41(4, Autumn, 2002): 212-218. Ohio State University. Retrieved from: https://doi.org/10.1207/s15430421tip4104_2
Krisnaresanti, A., Ahman, E., Istikomah, N., Suwatno & Budiman, A. (2024). Research trends in technological pedagogical content knowledge (TPACK) Research (2014-2024): A Scientometric Analysis. Jurnal Pendidikan Progresif, 14(1): 352-369. Retrieved from: https://doi.org/10.23960/jpp.v14.i1.202426
Ladwig, James G. (2007). ‘Modelling pedagogy in australian school reform’, Pedagogies: An International Journal 2 (2): 57–76. Retrieved from: https://doi.org/10.1080/15544800701343919
Lingard, B., Ladwig, J., Mills, M., Bahr, M., Chant, D., Warry, M., Ailwood, J., Capeness, R., Christie, P., Gore, J., Hayes, D. & Luke, A. (2001). The queensland school reform longitudinal study. Brisbane: Education Queensland.
Lingard, B., Hayes, D. and Mills, M. (2003). Teachers and productive pedagogies: contextualising, conceptualising, utilising. Pedagogy, Culture and Society, 11(3): 399-424. Retrieved from: https://doi.org/10.1080/14681360300200181
Mansourian, Y. (2008). Exploratory nature of, and uncertainty tolerance in, qualitative research. New Library World. 109(5/6): 273–286. Retrieved from: https://doi.org/10.1108/03074800810873614
Miles, M. B. and Huberman, A. M. (1994) Qualitative data analysis: an expanded sourcebook. (Second Edition). Thousand Oaks: Sage Publications.
Miller, A., Gore, J., Wallington, C., Harris, J., Prieto-Rodriguez, E., & Smith, M. (2019). Improving student outcomes through professional development: Protocol for a cluster randomised controlled trial of Quality Teaching Rounds. International Journal of Educational Research, 98, 146–158. Retrieved from: https://doi.org/10.1016/j.ijer.2019.09.002
Musfah, J. (2015). Manajemen pendidikan: teori, kebijakan, dan praktik. Jakarta: Kencana.
Nazari N., Nafissi Z., Estaji, M. & Marandi, S. S. (2019). Evaluating novice and experienced EFL teachers’ perceived TPACK for their professional development. Cogent Education. 6(1): Article 1632010, 1-26. Retrieved from: https://doi.org/10.1080/2331186X.2019.1632010
Newmann, F. M. & Wehlage, G. G. (1995). Successful school restructuring: a report to the public and educators by the center on organization and restructuring of schools. Madison: board of regents of the university of wisconsin system. Retrieved from: http://files.eric.ed.gov/fulltext/ED387925.pdf
New South Wales Department of Education and Training (NSW DET). (2006). Quality teaching in nsw public schools: a classroom practice guide (second edition). Retrieved from: https://maryland-p.schools.nsw.gov.au/content/dam/doe/sws/schools/m/maryland-p/localcontent/qt_classroom_practiceguide.pdf
New South Wales Department of Education and Training (NSW DET). (2020). Quality Teaching Classroom Practice Guide. (Third Edition). [Digital version].
OECD. (2023). PISA 2022 results volume i: the state of learning and equity in education. Paris: OECD Publishing. Retrieved from: https://doi.org/10.1787/53f23881-en
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and policy in mental health, 42(5), 533–544. Retrieved from: https://doi.org/10.1007/s10488-013-0528-y
Rahman, A. (2016). Teacher professional development in Indonesia: The influences of learning activities, teacher characteristics and school conditions. [Doctoral Thesis, University of Wollongong]. Retrieved from: https://ro.uow.edu.au/theses/4721
Republic of Indonesia Constitutional Law. 1945/4.
Ryan, A., Prieto-Rodriguez, E., Miller, A. and Gore, J. (2024). What can implementation science tell us about scaling interventions in school settings? A scoping review. Educational Research Review. 44(2024): Article 100620. Retrieved from: https://doi.org/10.1016/j.edurev.2024.100620
Shulman, L. S. (1987). Knowledge and teaching: foundations of the new reform. Harvard Educational Review, 57(1): 1-22. Retrieved from: http://dx.doi.org/10.17763/haer.57.1.j463w79r56455411
Silova, I., Rappleye, J. & Auld, E. (2020). Beyond the western horizon: rethinking education, values, and policy transfer. In Handbook of Education Policy Studies: Values, Governance, Globalization, and Methodology (Volume 1, Chapter 1). Guorui Fan and Thomas S. Popkewitz (Eds). Singapore: SpringerOpen. [eBook]. Retrieved from: https://rdcu.be/dVhWM
Trenholm-Jenson, E. A., Burns, L., Trenholm, J. L. & Hand, C. J. (2022) Beyond tingles: An exploratory qualitative study of the Autonomous Sensory Meridian Response (ASMR). PLoS ONE, 17(12): e0277962. Retrieved from: https://doi.org/10.1371/journal.pone.0277962
Usman, Nasir & A.R, Murniati. (2019). Pengantar manajemen pendidikan. Online: An1mage.
Wahyudi, W. E., Fakhrudiin, A. H. & Ikmal, H. (2024). Educational verses in the qur’anic text: pedagogical and andragogy perspectives. Jurnal Pendidikan Progresif, 14(1): 650-663. Retrieved from: https://doi.org/10.23960/jpp.v14.i1.202447
World Bank (2015) Indonesia: teacher certification and beyond, Report No. 94019-ID, Washington DC: World Bank.
Xu, W. and Zammit, K. (2020). Applying thematic analysis to education: a hybrid approach to interpreting data in practitioner research. International Journal of Qualitative Methods. 19(2020). 1-9. Retrieved from: https://doi.org/10.1177/1609406920918810
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 Jurnal Pendidikan Progresif
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
View My Stats
The copyright is reserved to The Jurnal Pendidikan Progresif that is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.