A rule-based expert system for teachers’ certification in the use of learning management systems

  1. Luisa M. Regueras 1
  2. María Jesús Verdú 1
  3. Juan-Pablo de Castro 1
  1. 1 Universidad de Valladolid
    info

    Universidad de Valladolid

    Valladolid, España

    ROR https://ror.org/01fvbaw18

Revista:
IJIMAI

ISSN: 1989-1660

Año de publicación: 2022

Volumen: 7

Número: 7

Páginas: 75-81

Tipo: Artículo

DOI: 10.9781/IJIMAI.2022.11.004 DIALNET GOOGLE SCHOLAR lock_openDialnet editor

Otras publicaciones en: IJIMAI

Objetivos de desarrollo sostenible

Resumen

In recent years and accelerated by the arrival of the COVID-19 pandemic, Learning Management Systems (LMS) are increasingly used as a complement to university teaching. LMS provide an important number of resources and activities that teachers can freely select to complement their teaching, which means courses with different usage patterns difficult to characterize. This study proposes an expert system to automatically classify courses and certify teachers’ LMS competence from LMS logs. The proposed system uses clustering to stablish the classification scheme. From the output of this algorithm, it defines the rules used to classify courses. Data registered from a university virtual campus with 3,303 courses and two million interactive events have been used to obtain the classification scheme and rules. The system has been validated against a group of experts. Results show that it performs successfully. Therefore, it can be concluded that the system can automatically and satisfactorily evaluate and certify the teachers’ LMS competence evidenced in their courses.

Referencias bibliográficas

  • G. Y. Washington, “The Learning Management System Matters in Faceto-Face Higher Education Courses,” Journal of Educational Technology Systems, vol. 48, no. 2, 2019.
  • M. Cantabella, R. Martínez-España, B. López, and A. Muñoz, “A FineGrained Model to Assess Learner-Content and Methodology Satisfaction in Distance Education,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, no. 4, pp. 87-96, 2020, doi: 10.9781/ ijimai.2020.09.002.
  • N. Nadirah, M. Kasim, and F. Khalid, “Choosing the Right Learning Management System (LMS) for the Higher Education Institution Context: A Systematic Review,” International Journal of Emerging Technologies in Learning (iJET), vol. 11, pp. 55–61, 2016.
  • S. Machajewski, A. Steffen, E. Romero Fuerte, and E. Rivera, “Patterns in Faculty Learning Management System Use,” TechTrends, vol. 63, no. 5, pp. 543–549, Sep. 2019, doi: 10.1007/s11528-018-0327-0.
  • Y. Park and I.-H. Jo, “Using log variables in a learning management system to evaluate learning activity using the lens of activity theory,” Assessment & Evaluation in Higher Education, vol. 42, no. 4, pp. 531–547, May 2017, doi: 10.1080/02602938.2016.1158236.
  • E. Caglayan, O. O. Demirbas, A. B. Ozkaya, and M. Sahin, “EvidenceBased Learning Design Through Learning Analytics,” in Adoption of Data Analytics in Higher Education Learning and Teaching, D. Ifenthaler and D. Gibson, Eds. Cham: Springer International Publishing, 2020, pp. 407–424. doi: 10.1007/978-3-030-47392-1_21.
  • A. Antwi-Boampong, “Towards a faculty blended learning adoption model for higher education,” Education and Information Technologies, vol. 25, no. 3, pp. 1639–1662, May 2020, doi: 10.1007/s10639-019-10019-z.
  • A. Balderas, L. De-La-Fuente-Valentin, M. Ortega-Gomez, J. M. Dodero, and D. Burgos, “Learning Management Systems Activity Records for Students’ Assessment of Generic Skills,” IEEE Access, vol. 6, pp. 15958– 15968, 2018, doi: 10.1109/ACCESS.2018.2816987.
  • M. Awad, K. Salameh, and E. L. Leiss, “Evaluating Learning Management System Usage at a Small University,” in Proceedings of the 2019 3rd International Conference on Information System and Data Mining, New York, NY, USA, Apr. 2019, pp. 98–102. doi: 10.1145/3325917.3325929.
  • L. M. Regueras, M. J. Verdú, J. D. Castro, and E. Verdú, “Clustering Analysis for Automatic Certification of LMS Strategies in a University Virtual Campus,” IEEE Access, vol. 7, pp. 137680–137690, 2019, doi: 10.1109/ACCESS.2019.2943212.
  • H. Henderi, Q. Aini, A. D. Srengini, and A. Khoirunisa, “Rule based expert system for supporting assessment of learning outcomes,” International Journal of Advanced Trends in Computer Science and Engineering, vol. 9, no. 1.2, pp. 266–271, 2020.
  • S. Jain, P. Lodhi, O. Mishra, and V. Bajaj, “StuA: An Intelligent Student Assistant,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 5, no. 2, pp. 17-25, 2018, doi: 10.9781/ijimai.2018.02.008.
  • S. Hossain, D. Sarma, Fatema-Tuj-Johora, J. Bushra, S. Sen, and M. Taher, “A Belief Rule Based Expert System to Predict Student Performance under Uncertainty,” 2019 22nd International Conference on Computer and Information Technology (ICCIT), 2019, pp. 1-6, doi: 10.1109/ ICCIT48885.2019.9038564.
  • G.-J. Hwang, H.-Y. Sung, S.-C. Chang, and X.-C. Huang, “A fuzzy expert system-based adaptive learning approach to improving students’ learning performances by considering affective and cognitive factors,” Computers and Education: Artificial Intelligence, vol. 1, p. 100003, Jan. 2020, doi: 10.1016/j.caeai.2020.100003.
  • A. Milad et al., “An Educational Web-Based Expert System for Novice Highway Technology in Flexible Pavement Maintenance,” Complexity, vol. 2021, p. 6669010, Feb. 2021, doi: 10.1155/2021/6669010.
  • V. M. Ramesh, N. J. Rao, and C. Ramanathan, “Implementation of an Intelligent Tutoring System using Moodle,” in 2015 IEEE Frontiers in Education Conference (FIE), Oct. 2015, pp. 1–9. doi: 10.1109/ FIE.2015.7344313.
  • A. Q. AlHamad, N. Yaacob, and F. Al-Omari, “Applying JESS rules to personalize Learning Management System (LMS)using online quizzes,” in 2012 15th International Conference on Interactive Collaborative Learning (ICL), Sep. 2012, pp. 1–4. doi: 10.1109/ICL.2012.6402213.
  • F. Cervantes-Pérez, J. Navarro-Perales, A. L. Franzoni-Velázquez, and L. de la FuenteValentín, “Bayesian Knowledge Tracing for Navigation through Marzano’s Taxonomy,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, no. 6, pp. 234–239, 2021, doi: 10.9781/ijimai.2021.05.006.
  • M. Constapel, D. Doberstein, H. U. Hoppe, and H. Hellbrück, “IKARion: Enhancing a Learning Platform with Intelligent Feedback to Improve Team Collaboration and Interaction in Small Groups,” in 2019 18th International Conference on Information Technology Based Higher Education and Training (ITHET), Sep. 2019, pp. 1–10. doi: 10.1109/ ITHET46829.2019.8937348.
  • L. Huang, C.-D. Wang, H.-Y. Chao, J.-H. Lai, and P. S. Yu, “A Score Prediction Approach for Optional Course Recommendation via CrossUser-Domain Collaborative Filtering,” IEEE Access, vol. 7, pp. 19550– 19563, 2019, doi: 10.1109/ACCESS.2019.2897979.
  • A. Muñoz, J. Lasheras, A. Capel, M. Cantabella, and A. Caballero, “OntoSakai: On the optimization of a Learning Management System using semantics and user profiling,” Expert Systems with Applications, vol. 42, no. 15, pp. 5995–6007, Sep. 2015, doi: 10.1016/j.eswa.2015.04.019.
  • S. Sridharan, D. Saravanan, A. K. Srinivasan, and B. Murugan, “Adaptive learning management expert system with evolving knowledge base and enhanced learnability,” Education and Information Technologies, May 2021, doi: 10.1007/s10639-021-10560-w.
  • Á. F. Agudo-Peregrina, S. Iglesias-Pradas, M. Á. Conde-González, and Á. Hernández-García, “Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning,” Computers in human behavior, vol. 31, pp. 542–550, 2014. Regular Issue - 81 -
  • F. D. de la Pena Esteban, J. A. Lara Torralbo, D. Lizcano Casas, and M. A. Martinez Rey, “Expert system for problem solving in distance university education: The successful case of the subject ‘operations management,’” Expert Systems, vol. 36, no. 5, p. e12444, Oct. 2019, doi: 10.1111/exsy.12444.
  • M. Agaoglu, “Predicting Instructor Performance Using Data Mining Techniques in Higher Education,” IEEE Access, vol. 4, pp. 2379–2387, 2016, doi: 10.1109/ACCESS.2016.2568756.
  • S. San-Martín, N. Jiménez, P. Rodríguez-Torrico, and I. Piñeiro-Ibarra, “The determinants of teachers’ continuance commitment to e-learning in higher education,” Education and Information Technologies, vol. 25, no. 4, pp. 3205–3225, Jul. 2020, doi: 10.1007/s10639-020-10117-3.
  • C.-Y. Su, Y.-H. Li, and C.-H. Chen, “Understanding the Behavioural Patterns of University Teachers Toward Using a Learning Management System,” International Journal of Emerging Technologies in Learning (iJET), vol. 16, no. 14, Art. no. 14, Jul. 2021.
  • E. García, C. Romero, S. Ventura, and C. de Castro, “A collaborative educational association rule mining tool,” The Internet and Higher Education, vol. 14, no. 2, pp. 77–88, Mar. 2011, doi: 10.1016/j. iheduc.2010.07.006.
  • C. J. Villagrá-Arnedo, F. J. Gallego-Durán, F. Llorens-Largo, R. SatorreCuerda, P. Compañ-Rosique, and R. Molina-Carmona, “Time-Dependent Performance Prediction System for Early Insight in Learning Trends,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 6, no. 2, pp. 112–124, 2020, doi: 10.9781/ijimai.2020.05.006.
  • P. D. Reddy and A. Mahajan, “Expert System for Generating Teaching Plan Based on Measurable Learning Objectives and Assessment,” in 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT), Jul. 2016, pp. 207–208. doi: 10.1109/ICALT.2016.61.
  • O. Biletska, Y. Biletskiy, H. Li, and R. Vovk, “A semantic approach to expert system for e-Assessment of credentials and competencies,” Expert Systems with Applications, vol. 37, no. 10, pp. 7003–7014, Oct. 2010, doi: 10.1016/j.eswa.2010.03.018.
  • J. Fritz, “LMS Course Design As Learning Analytics Variable,” in Proceedings of the 1st learning analytics for curriculum and program quality improvement workshop, Edinburgh, Scotland, UK, 2016, pp. 15–19. Accessed: Sep. 06, 2021. Available: http://ceur-ws.org/Vol-1590/
  • C. Iwasaki, T. Tanaka, and K. Kubota, “Analysis of Relating the Use of a Learning Management System to Teacher Epistemology and Course Characteristics in Higher Education,” 2011, doi: 10.34105/j. kmel.2011.03.032.
  • J. Whitmer, N. Nuñez, T. Harfield, and D. Forteza, “Patterns in Blackboard Learn tool use: Five Course Design Archetypes.” Blackboard, 2016.
  • T. Harfield, “Analytics for Learn: Using Data Science to Drive Innovation in Higher Education - Blackboard Blog,” Apr. 27, 2017. https://blog. blackboard.com/analytics-for-learn-data-science-innovation-highereducation/ (accessed Jan. 26, 2022).
  • J. Fritz, T. Penniston, M. Sharkey, and J. Whitmer, “Scaling Course Design as a Learning Analytics Variable,” in Blended Learning, Routledge, 2021.
  • I. Bennacer, R. Venant, and S. Iksal, “Towards a Self-assessment Tool for Teachers to Improve LMS Mastery Based on Teaching Analytics,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12884 LNCS, pp. 320–325, 2021, doi: 10.1007/978-3-030-86436-1_28.
  • S. Abu-Naser, M. Barak, and A. Barak, “A Proposed Expert System For Guiding Freshman Students In Selecting A Major In Al-Azhar University, Gaza,” Sep. 01, 2008.
  • E. Mosqueira-Rey, V. Moret-Bonillo, and Á. Fernández-Leal, “An expert system to achieve fuzzy interpretations of validation data,” Expert Systems with Applications, vol. 35, no. 4, pp. 2089–2106, Nov. 2008, doi: 10.1016/j.eswa.2007.09.045.
  • E. Verdú, M. J. Verdú, L. M. Regueras, J. P. de Castro, and R. García, “A genetic fuzzy expert system for automatic question classification in a competitive learning environment,” Expert Systems with Applications, vol. 39, no. 8, pp. 7471–7478, 15 2012, doi: 10.1016/j.eswa.2012.01.115.
  • A. J. Viera and J. M. Garrett, “Understanding interobserver agreement: the kappa statistic,” Family Medicine, vol. 37, no. 5, pp. 360–363, May 2005.
  • Y. Li, “University Teachers’ Pedagogical Work with Canvas An exploration of teachers’ conceptions, design work and experiences with an LMS,” Master Thesis, Universitetet i Oslo, 2019. Accessed: Sep. 09, 2021. Available: https://www.duo.uio.no/handle/10852/73114
  • P. S. Muljana and T. Luo, “Utilizing learning analytics in course design: voices from instructional designers in higher education,” Journal of Computing in Higher Education, vol. 33, no. 1, pp. 206–234, Apr. 2021, doi: 10.1007/s12528-020-09262-y.
  • A. Goudarzi, C. Spehr, and S. Herbold, “Expert decision support system for aeroacoustic source type identification using clustering,” The Journal of the Acoustical Society of America, vol. 151, no. 2, pp. 1259–1276, Feb. 2022, doi: 10.1121/10.0009322
Fuente de los datos: Dialnet