Evaluareeddesarrollo de una herramienta para la evaluación de la calidad de los recursos educativos electrónicos

  1. María Pinto
  2. Carmen Gómez-Camarero
  3. Andrés Fernández-Ramos
  4. Anne-Vinciane Doucet
Journal:
Investigación bibliotecológica

ISSN: 2448-8321 0187-358X

Year of publication: 2017

Volume: 31

Issue: 72

Pages: 227-248

Type: Article

DOI: 10.22201/IIBI.0187358XP.2017.72.57831 DIALNET GOOGLE SCHOLAR

More publications in: Investigación bibliotecológica

Abstract

Abstract: The aim of this paper is to present the development of the Evaluareed instrument, designed to evaluate electronic educational resources, especially those oriented to higher education. From a review of the relevant scientific literature and using a qualitative-quantitative methodology, a set of criteria and sub-criteria are defined. The quality indicators of the checklist are: 1) quality of content, 2) learning aims and goals, 3) feedback, 4) usability, 5) motivation, 6) accessibility, 7) technical requirements, 8) intellectual property and 9) effectiveness of the resource in terms of learning. The instrument allows the evaluation of resources and generates a quality assessment report, showing data and improvement recommendations. It is available at a web site that also provides a repository of Open Course Ware (OCW) assessed from Spanish universities, a selection of literature and specialized information concerning project design.

Bibliographic References

  • Albion, P. R.. (1999). Heuristic evaluation of educational multimedia: from theory to practice. 16thAnnual Conference of the Australasian Society for Computers in Learning in Tertiary Education. Brisbane.
  • Barnes, S., Vidgen, R.. (2002). An integrative approach to the assessment of e-commerce quality. Journal of Electronic Commerce Research. 3. 114
  • Benson, L., Elliott, D., Grant, M., Holschuh, D., Kim, B., Kim, H., Lauber, E., Loh, S., Reeves, T. C.. (2002). Proceedings of the World Conference on Educational Multimedia, Hypermedia and Telecommunications 2002. AACE. Chesapeake, VA.
  • Blummer, B. A., Kritskaya, O.. (2009). Best Practices for Creating an Online Tutorial: A Literature Review. Journal of Web Librarianship. 3. 199-216
  • Bottentuit Junior, J. B., Coutinho, C. P.. (2008). The Conception of a Rubric to Evaluate Educational Portals on the Web. VIIIInternational Technology, Education and Development Conference (INTED 2008). Valencia. marzo.
  • (2002). Evaluating, selecting and managing learning resources.
  • Brodahl, C., Smestad, B. A.. (2009). A taxonomy as a Vehicle for Learning. Interdisciplinary Journal of E-Learning and Learning Objects. 5. 111
  • Coll, C., Mauri, T. Y., Onrubia, J.. (2008). Cómo valorar la calidad de la enseñanza basada en las TIC: Pautas e instrumentos de análisis. Graó. Barcelona.
  • Codina, L.. (2000). Evaluación de recursos digitales en línea: conceptos, indicadores y métodos. Revista Española de Documentación Científica. 23. 9-44
  • Colomina, R., Onrubia, J. Y., Rochera, M. J.. (2001). Interactividad, mecanismos de influencia educativa y construcción del conocimiento en el aula. Desarrollo psicológico y educación: 2 Psicología de la educación escolar.
  • Davids, M. R., Chikte, U. M., Halperin, M. L.. (2014). Effect of improving the usability of an e-learning resource: a randomized trial. Advances in physiology education. 38. 155
  • Downes, S.. (2011). Open educational resources: A definition.
  • El Mhouti, A., Nasseh, A., Erradi, M.. (2013). Development of a Tool for Quality Assessment of Digital Learning Resources. International Journal of Computer Applications. 64. 27-31
  • Ho, W., Higson, H. E., Dey, P. K., Xu, X., Bahsoon, R.. (2009). Measuring performance of virtual learning environment system in higher education. Quality Assurance in Education. 17. 6-29
  • Horila, M., Nokelainen, P., Syvänen, A.. (2002). Criteria for the pedagogical usability, version 1.0.. Häme Polytechnic and University of Tampere. Hämeenlinna, Finland.
  • (1998). Ergonomic requirements for visual display terminals. ISO/IEC 9241.
  • Keller, J. M.. (2010). Motivational design for learning and performance. Springer. New York.
  • Krauss, F., Ally, M.. (2005). A Study of the Design and Evaluation of a Learning Object and Implications for Content Development. Interdisciplinary Journal of Knowledge and Learning Objects. 1. 1-22
  • Kukulska-Hume, A., Shield, L.. (2004). Usability and Pedagogical Design: are Language Learning Websites Special?. ED-MEDIA 2004.
  • Laurillard, D.. (2002). Rethinking University Teaching: A Conversational Framework for the Effective Use of Learning Technologies. 2. Routledge. London and New York.
  • Lera, E., Fernández, C., Almirall, M.. (2009). Emotions: the forgotten key success in online learning. 13thUNESCO-APEID International Conference and World Bank-KERIS High Level Seminar on ICT in Education. Hangzhou, China.
  • (2010). The Delivery Guide: Evaluating learning resources.
  • Marzal, M. A., Calzada-Prado, J., Viannello, M.. (2008). Criterios para la evaluación de la usabilidad de los recursos educativos virtuales: un análisis desde la alfabetización en información. Information Research. 13.
  • Morales Morgado, E., Gómez Aguilar, D. A., García Penalvo, F. J.. (2008). X Simposio Internacional de Informática Educativa. Universidad de Salamanca. Salamanca.
  • Nesbit, J. C., Belfer, K., Leacock, T.. (2003). Learning object review instrument (LORI). User Manual.
  • Nesbit, J. C., Belfer, K. Y., Vargo, J.. (2002). A convergent participation model for evaluation of learning objects. Canadian Journal of Learning and Technology. 28. 105
  • Nielsen, J.. (1993). Usability engineering. Academic Press. New York.
  • Nokelainen, P.. (2004). Proceedings of Society for Information Technology & Teacher Education International Conference 2004. AACE. Chesapeake, VA.
  • Nokelainen, P.. (2006). An empirical assessment of pedagogical usability criteria for digital learning material with elementary school students. Educational Technology & Society. 9. 178
  • Olive, J., Makar, K., Hoyos, V., Kor, L. K., Kosheleva, O., Sträßer, R.. (2010). Mathematics Education and Technology-Rethinking the Terrain. Springer. New York.
  • Oliver, R.. (2005). Quality assurance and e-learning: blue skies and pragmatism. ALT-J, Research in Learning Technology. 13. 173
  • Picard, R. W., Papert, S., Bender, W., Blumberg, B., Breazeal, C., Cavallo, D., Machover, T., Resnick, M., Roy, D., Strohecker, C.. (2004). Affective Learning: a manifesto. BT Technology Journal. 22. 253
  • Pinto, M., Gómez-Camarero, C., Fernández-Ramos, A.. (2012). Los recursos educativos electrónicos: perspectivas y herramientas de evaluación. Perspectivas em Ciência da Informação. 17. 82-99
  • Preece, J., Rogers, Y., Sharp, H.. (2002). Interaction Design: Beyond Human-Computer Interaction. John Wiley & Sons. New York.
  • Quinn, C. N.. (1996). Pragmatic evaluation: lessons from usability. 13th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education, Adelaide.
  • Reeves, T. C.. (1997). Evaluating What Really Matters in Computer-Based Education.
  • Richter, T., McPherson, M.. (2012). Open Educational Resources: Education for the World?. Distance Education. 33. 201
  • Richter, T., Veith, P.. (2014). Fostering the Exploitation of Open Educational Resources. Open Praxis. 6. 205
  • Scanlon, E.. (2014). Scholarship in the digital age: Open educational resources, publication and public engagement. British Journal of Educational Technology. 45. 12-23
  • Shneiderman, B.. (1998). Designing the user interface: strategies for effective human-computer interaction. Addison-Wesley. Reading.
  • Squires, D.. (1999). Usability and Educational Software Design: Special Issue of Interacting with Computers. Interacting with Computers. 11. 463
  • Squires, D., Preece, J.. (1996). Usability and learning: evaluating the potential of educational software. Computers and Education. 27. 15-22
  • Squires, D., Preece, J.. (1999). Predicting quality in educational software: Evaluating for learning, usability and the synergy between them. Interacting with Computers. 11. 467
  • (2007). Checklist for Evaluating SREB-SCORE Learning Objects.
  • (2008). Evaluation Criteria for SREB-SCORE Assets.
  • Toll, Y. C., Ril, Y.. (2013). Aspectos e indicadores para evaluar la calidad de los objetos de aprendizaje creados en la Universidad de las Ciencias Informáticas. Revista de Universidad y Sociedad del Conocimiento. 10. 149
  • Tramullas, J.. (2004). El diseño centrado en el usuario para la creación de productos y servicios de información digital. Revista iberoamericana sobre usuarios de información Forinf@ Online. 2223. 6-14
  • (2002). Forum on the impact of open courseware for higher education in developing countries: final report.
  • Wang, Y., Chen, N. S.. (2009). Criteria for evaluating synchronous learning management systems: arguments from the distance language classroom. Computer Assisted Language Learning. 22. 1-18
  • Zaharias, P., Poylymenakou, A.. (2009). Developing a Usability Evaluation Method for E-learning Applications: From Functional Usability to Motivation to Learn. International Journal of Human-Computer Interaction. 25. 75-98