Email this article Evaluation of the Effectiveness of Online Training to Improve Lecturers Ability in E-Learning Management Using the Kirkpatrick Model
Abstract
Abstract: Evaluation of the Effectiveness of Online Training to Improve Lecturers Ability in E-Learning Management Using the Kirkpatrick Model. Objectives: This study aims at the effectiveness of online training for lecturers in managing e-learning. This study uses an evaluation evaluation method with the Kirkpatrick model which includes evaluation of reactions, learning, behavior and results. Methods: The research approach is a mixed method with a sequential explanation model, where quantitative methods are used first and then qualitative methods are used in the next stage. Data collection techniques using questionnaires, and interviews. The research subjects are lecturers and students. Qualitative data were analyzed using the Miles and Huberman model and quantitative data were processed descriptively by calculating percentages and categorizing. Findings: The results showed that the reaction aspect was satisfied, learning was in the high category, behavior was in the moderate category and the results were in the good category. Conclusion: it works effectively, but needs improvement in the technical implementation of the training.
Keywords: evaluation, e-training, Kirkpatrick, e-learning.
Abstrak: Evaluasi Efektivitas Pelatihan Online untuk Meningkatkan Kemampuan Dosen Dalam Manajemen E-Learning Menggunakan Model Kirkpatrick. Tujuan: Penelitian ini bertujuan untuk mengevaluasi efektifitas pelatihan secara online bagi dosen dalam mengelola e-learning. Penelitian menggunakan metode penelitian evaluasi dengan model Kirkpatrick yang meliputi evaluasi reaksi, belajar, perilaku dan hasil. Metode: Pendekatan penelitian adalah mix method dengan model sequential explanatory, di mana metode kuantitatif digunakan terlebih dahulu kemudian pada tahap berikutnya menggunakan metode kualitatif. Teknik pengumpulan data menggunakan angket, dan wawancara. Subjek penelitian adalah dosen dan mahasiswa. Data kualitatif dianalisis dengan model Miles and Huberman dan data kuantitatif diolah secara deskriptif dengan menghitung presentase dan pengkategorian. Temuan: Hasil penelitian menunjukkan bahwa aspek reaksi berada pada kategori puas, belajar pada kategori tinggi, perilaku pada kategori cukup dan hasil berada pada kategori baik. Kesimpulan: pelatihan berjalan efektif, namun perlu perbaikan pada teknis pelaksanaan pelatihan.
Kata kunci: evaluasi, pelatihan, online Kirkpatrick, e–learning.
Full Text:
PDFReferences
Aji, R. H. S. (2020). Dampak Covid-19 pada Pendidikan di Indonesia: Sekolah, Keterampilan, dan Proses Pembelajaran. SALAM: Jurnal Sosial Dan Budaya Syar- I, 7(5), 395–402.
https://doi.org/10.15408/sjsbs.v7i5.15314 Ali, M., Hossain, S. . K., & Ahmed, T. (2018).
Effectiveness of E-Learning for University Students: Evidence from Bangladesh. Asian Journal of Empirical Research, 8(10), 352–360.
https://doi.org/10.18488/journal.1007/201 8.8.10/1007.10.352.360
Alsalamah, A., & Callinan, C. (2021). Adaptation of Kirkpatrick’s four-level model of training criteria to evaluate training programmes for head teachers. Education Sciences, 11(3). https://doi.org/10.3390/educsci11030116 Arkorful, V., & Abaidoo, N. (2015). The role of e-learning, advantages and disadvantages of its adoption in higher education. International Journal of Instructional Technology and Distance
Learning, 12(1), 29–42.
Baczek, M., Zaganczyk-Baczek, M., Szpringer, M., Jaroszynski, A., & Wozakowska-Kapłon, B. (2021). Student’s Perception of Online Learning during COVID Pandemic. Medicine, 100(7), 1–6.
https://doi.org/10.1007/s12098-020- 03327-7
Bali, S., & Liu, M. C. (2018). Students’ perceptions toward online learning and face-to-face learning courses. Journal of Physics: Conference Series, 1108(1). https://doi.org/10.1088/1742- 6596/1108/1/012094
Calvo, S., Morales, A., & Wade, J. (2019). The use of MOOCs in social enterprise education: an evaluation of a North– South collaborative FutureLearn program. Journal of Small Business and Entrepreneurship, 31(3), 201–223. https://doi.org/10.1080/08276331.2018.1 453241
Deodhar, M. and Powdwal, S. (2017). Impact of Continuing Education Programs (CEPs) on LIS Professionals in Academic Libraries in Mumbai, India. Library Management, 38(2/3), 117–130. https://doi.org/10.1108/LM-07-2016- 0051
Dewi, L. R., & Kartowagiran, B. (2018). An evaluation of internship program by using Kirkpatrick evaluation model. Research and Evaluation in Education, 4(2), 155–
https://doi.org/10.21831/reid.v4i2.22495 Dhawan, S. (2020). Online Learning: A
Panacea in the Time of COVID-19 Crisis. Journal of Educational Technology Systems, 49(1), 5–22. https://doi.org/10.1177/004723952093401 8
Dorri, S., Akbari, M., & Dorri Sedeh, M. (2016). Kirkpatrick evaluation model for in-service training on cardiopulmonary resuscitation. Iranian Journal of Nursing and Midwifery Research, 21(5), 493–497. https://doi.org/10.4103/1735- 9066.193396
Eghtesadi, A. R., & Hassanabadi, S. (2016). An Evaluation of In-Service Training Courses for the Seventh Grade English Package for Iranian Schools ( Prospect 1 ). Journal of Applied Linguistics and Language Research, 3(5), 130–143.
Fidiantara, F., Lestari, A., Juniati, N., Syukur, A., & Jamaluddin, J. (2021). Innovation of learning methods during the covid-19 pandemic at junior high school in Mataram City and West Lombok Regency. Jurnal Pijar Mipa, 16(4), 479–485.
https://doi.org/10.29303/jpm.v16i4.2749 Firmansyah, A., & Aima, H. (2020). Pengaruh
pelatihan, kompensasi, dan motivasi kerja terhadap kinerja karyawan. Journal FEB Unmul: Kinerja, 17(2), 172–185. https://doi.org/http://dx.doi.org/10.29264/ jkin.v17i2.7050
Husain, B., Idi, Y. N., & Basri, M. (2021). Teachers’ Perceptions on Adopting E- Learning During Covid-19 Outbreaks; Advantages, Disadvantages, Suggestions. Jurnal Tarbiyah, 27(2), 41–57. https://doi.org/10.30829/tar.v27i2.738
Hussein, E., Daoud, S., Alrabaiah, H., & Badawi, R. (2020). Exploring undergraduate students’ attitudes towards emergency online learning during COVID-19: A case from the UAE. Children and Youth Services Review, 119, 105699.
https://doi.org/10.1016/j.childyouth.2020
.105699
I. Dhull, M. S. (2017). Online Learning. International Education & Research Journal [IERJ], 3(8), 32–34. https://doi.org/10.1007/978-3-030- 33120-7_6
Ismail, A., Zaharudin, R., Hashim, N., & Ariffin, J. (2020). The Impact of e- NPQEL on the Continuance Intention of Using e-Training among Aspired School Leaders in Malaysia. International Journal of Interactive Mobile Technologies, 14(19), 109–123. https://doi.org/10.3991/ijim.v14i19.1596 5
Jain, G., Sharma, N., & Shrivastava, A. (2021). Enhancing training effectiveness for organizations through blockchain- enabled training effectiveness measurement (BETEM). Journal of Organizational Change Management, 34(2), 439–461.
https://doi.org/10.1108/JOCM-10-2020- 0303
Joan, R. (2013). Flexible Learning As New Learning Design In Classroom Process To Promote Quality Education. I- Manager’s Journal on School Educational Technology, 9(1), 37–42. https://doi.org/10.26634/jsch.9.1.2401
Jones, C., Fraser, J., & Randall, S. (2018). The evaluation of a home-based paediatric nursing service: concept and design development using the Kirkpatrick model. Journal of Research in Nursing, 23(6), 492–501. https://doi.org/10.1177/17449871187860 19
Kamal, K., Alaghbari, M., & Atteia, M. (2016). E-training & employees ’ performance a practical study on the ministry of education in the Kingdom of Bahrain E-Training & Employees ’ Performance a Practical Study on the Ministry of Education in the Kingdom of Bahrain. Journal of Resources Development and Management ISSN 2422-8397 An International Peer- Reviewed Journal Vol.18, 18(March), 1–8. Kirkpatrick, J. & Kirkpatrick, W. (2009). The Kirkpatrick Model: Past, Present and
Future.
Lampong Klomkul, P. (2021). Technological Innovation for Online Learning during the Situation of COVID-19 Pandemic in Thailand. Psychology and Education Journal, 58(1), 1578–1584.
https://doi.org/10.17762/pae.v58i1.949 Luckyardi, S., & Rahman, L. (2021).
Application of E-Learning System in the World of Education. Jurnal Teknologi Informasi Dan Pendidikan, 14(1), 47–52. https://doi.org/10.24036/tip.v14i1.327
Mahmoodi, M., Rashtchi, M., & Abbasian, G.
R. (2019). Evaluation of in-service teacher training program in iran: Focus on the Kirkpatrick model. Education and Self Development, 14(4), 20–38. https://doi.org/10.26907/esd14.4.03
Marini, S., & Milawati, M. (2020). Distance Learning Innovation Strategy in Indonesia During the COVID-19 Pandemic. 488(Aisteel), 416–421.
https://doi.org/10.2991/assehr.k.201124.0 85
Maudsley, G., & Taylor, D. (2020). Analysing synthesis of evidence in a systematic review in health professions education: observations on struggling beyond Kirkpatrick. Medical Education Online, 25(1).
https://doi.org/10.1080/10872981.2020.17 31278
Mawardi. (2020). Keefektifan Flexible Learning dalam Menumbuhkan Self- Regulated Learning dan Hasil Belajar Mahasiswa PGSD. Scholaria: Jurnal Pendidikan Dan Kebudayaan, 10(3), 251–262.
https://doi.org/10.24246/j.js.2020.v10.i3. p251-262
Miles,M.B, Huberman,A.M, dan Saldana, J. (2014). Qualitative Data Analysis, A Methods Sourcebook, Edition 3. Sage Publications. Terjemahan Tjetjep Rohindi Rohidi UI-Press
Ngabiyanto, Nurkhin, A., Mukhibad, H., & Harsono. (2021). E-learning evaluation using general extended technology acceptance model approach at schools in COVID-19 pandemic. European Journal of Educational Research, 10(3), 1171–
https://doi.org/10.12973/EU- JER.10.3.1171
Noori, A. Q. (2021). The Impact of COVID- 19 Pandemic on Students’ Learning in Higher Education in Afghanistan. Heliyon, 7(June), e08113. https://doi.org/10.1016/j.heliyon.2021.e0 8113
Park, Y., & Jo, I. H. (2019). Factors that affect the success of learning analytics dashboards. Educational Technology Research and Development, 67(6), 1547–
https://doi.org/10.1007/s11423-
-09693-0
Paull, M., Whitsed, C., & Girardi, A. (2016a). Applying the Kirkpatrick model: Evaluating an Interaction for Learning Framework curriculum intervention. Issues in Educational Research, 26(3), 490–507.
Paull, M., Whitsed, C., & Girardi, A. (2016b). Applying the Kirkpatrick model: Evaluating an Interaction for Learning Framework curriculum intervention. Issues in Educational Research, 26(3), 490–507. https://doi.org/10.1111/eje.12112
Putranto, A. (2011). Perancangan Training dengan E-Learning pada Perusahaan Manufacture. ComTech: Computer, Mathematics and Engineering Applications, 2(1), 317.
https://doi.org/10.21512/comtech.v2i1.27 58
Ragsdale, J. W., Berry, A., Gibson, J. W., Herber-Valdez, C. R., Germain, L. J., & Engle, D. L. (2020). Evaluating the effectiveness of undergraduate clinical education programs. Medical Education Online, 25(1).
https://doi.org/10.1080/10872981.2020.17 57883
Rayuwati, R. (2020). How educational technology innovates distance learning during pandemic crisis in remote areas in Indonesia? International Research Journal of Management, IT and Social Sciences, 7(6), 161–166. https://doi.org/10.21744/irjmis.v7n6.1032 Ruskanda, L. (2018). Implementation of the Kirkpatrick Model Training Program Evaluation. International Journal of Advanced Research, 6(8), 878–892.
https://doi.org/10.21474/ijar01/7590 Sahni, J. (2020). Managerial training
effectiveness: An assessment through Kirkpatrick framework. TEM Journal, 9(3), 1227–1233.
https://doi.org/10.18421/TEM93-51 Salamatina, Y. V. (2020). The use of e-
learning resources in distance learning. Journal of Physics: Conference Series, 1691(1). https://doi.org/10.1088/1742-
/1691/1/012189
Sari, A. U. (2021). Evaluasi Pelatihan Dengan Model Evaluasi Kirkpatrick Di Balai Perlindungan Dan Rehabilitasi Sosial Wanita (Bprsw). Jurnal Manajemen Pendidikan Dan Pelatihan, 5(3), 269–274. Thanji, M., & Vasantha, S. (2018). A Study of Benefits and Limitations of e- Learning-A Learner ’ s Perspective. 118(5), 175–184.
Zahro, S., & Wu, M. C. (2016).
Implementing of the employees training evaluation using Kirkpatrick’s model in tourism industry-A case study. International Journal of Innovation and Applied Studies, 17(3), 1042–1049. http://www.ijias.issr-journals.org/
Zain, Z. M., & Nurudin, S. M. (2016). Kirkpatrick’s Training Evaluation Model in Associates with the Effectiveness of Skim Latihan 1 Malaysia (SL1M). Journal of Education and Social Science, 5(2), 175–180. http://jesoc.com/wp- content/uploads/2016/12/KC5_66.pdf
Zalat, M. M., Hamed, M. S., & Bolbol, S. A. (2021). The experiences, challenges, and acceptance of e-learning as a tool for teaching during the COVID-19 pandemic among university medical staff. PLoS ONE, 16(3 March), 1–12.
https://doi.org/10.1371/journal.pone.024 8758
Zuhir, A., Rawashdeh, A., Mohammed, E. Y., Rebhi, A., Arab, A., Alara, M., & Al- rawashdeh, B. (2021). Advantages and Disadvantages of Using e-Learning in University Education : Analyzing Students ’ Perspectives. 19(2), 107–117.
Refbacks
- There are currently no refbacks.
Copyright (c) 2022 Jurnal Pendidikan Progresif
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
View My Stats
The copyright is reserved to The Jurnal Pendidikan Progresif that is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.