Assessment co-creation mediated by technology and its relation to university students' agency and self-regulation: The professors' perspective
DOI:
https://doi.org/10.21814/rpe.32964Keywords:
Co-Creation, Assessment, Self-Regulation, Agency, Higher EducationAbstract
Assessment co-creation is emerging with increasing frequency in co-designing learning practices in technology-enhanced learning environments in higher education. Thus, the objective of this study is to analyse whether these practices are related to students’ self-regulation and agency. Therefore, a qualitative multi-case study from a phenomenology perspective was conducted. To collect data, six professors were interviewed (four female and two males) following a semi-structured approach in order to gain their perceptions of their experiences in the assessment co-creation process and their views on the relationship of this process to students’ self-regulation and agency. To analyse the data, a deductive coding method was followed using the data analysis tool Atlas.ti. The findings show that from the professors’ points of view various relationships exist between the assessment co-creation mediated by technologies and students’ self-regulation and agency. Interviewees perceived that assessment co-creation activated both students’ agency and their self-regulation skills. From the results, it is suggested that assessment co-creation can enhance students’ self-regulation in all its phases but mainly in terms of forethought. Similarly, students’ agency seems to be boosted by the co-design process, highlighting the effect on the individual dimension. Accordingly, and related to the more developed areas of students’ self-regulation and agency, motivation seems to increase while co-creating.
Downloads
References
Benítez-Sillero, J. D., Villena-Serrano, M., Castejón-Riber, C., & Morente-Montero, Á. (2020). Ex- periencia innovadora en alumnado universitario del grado de educación primaria mediante la utilización del Kahoot. In E. López, D. Cobos, L. Molina, A. Jaén & A. Martín (Eds), Claves para la innovación pedagógica ante los nuevos retos: Respuestas en la vanguardia de la práctica educativa (pp. 2031-2039). Octaedro.
Bergmark, U., & Westman, S. (2016). Co-creating curriculum in higher education: Promoting democratic values and a multidimensional view on learning. International Journal for Academic Development, 21(1), 28–40. https://doi.org/10.1080/1360144X.2015.1120734
Blau, I., & Shamir-Inbal, T. (2018). Digital technologies for promoting “student voice” and co-creating learning experience in an academic course. Instructional Science, 46(2), 315– 336. https://doi.org/10.1007/s11251-017-9436-y
Bovill, C. (2020). Co-creation in learning and teaching: the case for a whole-class approach in higher education. Higher Education, 79(6), 1023–1037. https://doi.org/10.1007/s10734-019-00453-w
Bovill, C., & Bulley, C. J. (2011). A model of active student participation in curriculum design: Exploring desirability and possibility. In C. Rust (Ed.), Improving student learning (18) Global theories and local practices: Institutional, disciplinary and cultural variations (pp. 176–188). The Oxford Centre for Staff and Educational Development.
Bovill, C., Cook-Sather, A., Felten, P., Millard, L., & Moore-Cherry, N. (2016). Addressing potential challenges in co-creating learning and teaching: Overcoming resistance, navigating institutional norms and ensuring inclusivity in student–staff partnerships. Higher Education, 71(2), 195–208. https://doi.org/10.1007/s10734-015-9896-4
Deeley, S. J., & Bovill, C. (2017). Staff student partnership in assessment: enhancing assessment literacy through democratic practices. Assessment & Evaluation in Higher Education, 42(3), 463–477. https://doi.org/10.1080/02602938.2015.1126551
Dollinger, M., & Lodge, J. (2020). Student-staff co-creation in higher education: an evidence-informed model to support future design and implementation. Journal of Higher Education Policy and Management, 42(5), 532–546. https://doi.org/10.1080/ 1360080X.2019.1663681
Dollinger, M., Lodge, J., & Coates, H. (2018). Co-creation in higher education: Towards a conceptual model. Journal of Marketing for Higher Education, 28(2), 210–231. https://doi.org/10.1080/08 841241.2018.1466756
Dorta, T., Kinayoglu, G., & Boudhraâ, S. (2016). A new representational ecosystem for design teaching in the studio. Design Studies, 47, 164–186. https://doi.org/10.1016/ j.destud.2016.09.003
Doyle, E., & Buckley, P. (2020). The impact of co-creation: An analysis of the effectiveness of student authored multiple choice questions on achievement of learning outcomes. Interactive Learning Environments, 30(1), 1–10. https://doi.org/10.1080/ 10494820.2020.1777166
Doyle, E., Buckley, P., & McCarthy, B. (2020). The impact of content co-creation on academic achievement. Assessment & Evaluation in Higher Education, 46(3), 494–507. https://doi.org/10.1080/02602938.2020.1782832
Doyle, E., Buckley, P., & Whelan, J. (2019). Assessment co-creation: An exploratory analysis of opportunities and challenges based on student and instructor perspectives. Teaching in Higher Education, 24(6), 739–754. https://doi.org/10.1080/13562517.2018.1498077
Fraile, J., Panadero, E., & Pardo, R. (2017). Co-creating rubrics: The effects on self-regulated learning, self-efficacy and performance of establishing assessment criteria with students. Studies in Educational Evaluation, 53, 69–76. https://doi.org/10.1016/ j.stueduc.2017.03.003
Gómez-Ruiz, M.A., & Quesada-Serra, V. (2020). Análisis de las calificaciones compartidas en la modalidad participativa de la evaluación colaborativa entre docente y estudiantes [Analysis of shared grades in the participatory modality of collaborative evaluation between teacher and students]. RELIEVE, 26(1): M6. https://doi.org/10.7203/relieve.26.1.16567
Gros, B., & López, M. (2016). Students as co-creators of technology-rich learning activities in higher education. International Journal of Educational Technology in Higher Education, 13(1), 1–13. https://doi.org/10.1186/s41239-016-0026-x
Haraldseid, C., Friberg, F., & Aase, K. (2016). How can students contribute? A qualitative study of active student involvement in development of technological learning material for clinical skills training. BMC Nursing, 15(1), 1–10. https://doi.org/10.1186/s12912-016-0125-y
Hernández-Sampieri, R. (2018). Metodología de la investigación: Las rutas cuantitativa, cualitativa y mixta [Research methodology: quantitative, qualitative and mixed routes]. McGraw Hill.
Hortigüela, D., Palacios, A., & López, V. (2019). The impact of formative and shared or co-assessment on the acquisition of transversal competences in higher education. Assessment & Evaluation in Higher Education, 44(6), 933–945, http://doi.org/10.1080/02602938.2018.1530341
Hussain, S., Gamage, K. A. A., Ahmad, W., & Imran, M. A. (2019). Assessment and feedback for large classes in transnational engineering education: Student-staff partnership-based innovative approach. Education Sciences, 9(3). https://doi.org/10.3390/educsci9030221
Jääskelä, P., Poikkeus, A.M., Vasalampi, K., Valleala, U.M., & Rasku-Puttonen, H. (2017). Assessing agency of university students: Validation of the AUS Scale. Studies in Higher Education, 42(11), 2061–2079. https://doi.org/10.1080/03075079.2015.1130693
Kaminskiene, L., Žydžiunaite, V., Jurgile, V., & Ponomarenko, T. (2020). Co-creation of learning: a concept analysis. European Journal of Contemporary Education, 9(2), 337–349. https://doi.org/10.13187/ejced.2020.2.337
Lubicz-Nawrocka, T., & Owen, J. (2022). Curriculum co-creation in a postdigital world: Advancing networked learning and engagement. Postdigital Science & Education, 4, 793–813. https://doi.org/10.1007/s42438-022-00304-5
Marin, V.I., de Benito Crosetti, B., & Darder, A. (2020). Technology-enhanced learning for student agency in higher education: A systematic literature review. IxD&A, 45, 15–49. https://doi.org/10.55612/s-5002-045-001
Martens, S. E., Meeuwissen, S. N. E., Dolmans, D. H. J. M., Bovill, C., & Könings, K. D. (2019). Student participation in the design of learning and teaching: Disentangling the terminology and approaches. Medical Teacher, 41(10), 1203–1205. https://doi.org/10.1080/0142159X.2019.1615610
McWilliam, E. (2008). Unlearning how to teach. Innovations in Education and Teaching International, 45(3), 263–269. https://doi.org/10.1080/14703290802176147
Mercer-Mapstone, L., Dvorakova, S. L., Matthews, K. E., Abbot, S., Cheng, B., Felten, P., Knorr, K., Marquis, E., Shammas, R., & Swaim, K. (2017). A systematic literature review of students as partners in higher education. International Journal for Students as Partners, 1(1), 15–37. https://doi.org/10.15173/ijsap.v1i1.3119
Moreno-Guerrero, A. J., Soler-Costa, R., Marín-Marín, J. A., & López Bel-monte, J. (2021). Flipped learning y buenas prácticas docentes en educación secundaria [Flipped learning and Good teaching practices in secondary education]. Comunicar, 68, 107–117. https://doi.org/10.3916/C68-2021-09
Neubauer, B. E., Witkop, C. T., & Varpio, L. (2019). How phenomenology can help us learn from the experiences of others. Perspectives on Medical Education, 8(2), 90–97. https://doi.org/10.1007/S40037-019-0509-2
Nicol, D. (2010). The foundation for Graduate Attributes: Developing self-regulation through self and peer assessment. Quality Assurance Agency for Higher Education. http://www.enhancementthemes.ac.uk/themes/21stCGraduates/outcomes.asp
Quesada, V., Garcia-Jimenez, E., & Gomez-Ruiz, M. A. (2017). Student participation in assessment processes: a way forward. In E. Cano & G. Ion (Eds.), Innovative practices for higher education assessment and measurement (pp. 226–247). IGI Global. https://doi.org/10.4018/978-1-5225-0531-0.ch012
Quesada, V., Gómez Ruiz, M. Á., Gallego Noche, M. B., & Cubero-Ibáñez, J. (2019). Should I use co-assessment in higher education? Pros and cons from teachers and students’ perspectives. Assessment & Evaluation in Higher Education, 44(7), 987–1002. https://doi.org/10.1080/02602938.2018.1531970
Salinas, J. M., & de Benito Crosetti, B. L. (2020). Construcción de itinerarios personalizados de aprendizaje mediante métodos mixtos [Construction of personalized learning pathways through mixed methods]. Comunicar: Revista científica iberoamericana de comunicación y educación, 65, 31–42. https://doi.org/10.3916/C65-2020-03
Sanina, A., Kutergina, E., & Balashov, A. (2020). The co-creative approach to digital simulation games in social science education. Computers & Education, 149: 103813. https://doi.org/10.1016/j.compedu.2020.103813
Santana-Martel, JS and Pérez-Garcias, A. (2022a). Students’ Agency and Self-Regulated Skills through the Lenses of Assessment Co-creation in Post-COVID-19 Online and Blended Settings: A Multi-Case Study. Journal of Interactive Media in Education, 2022(1), 8. https://doi.org/10.5334/jime.746
Santana-Martel, J.S. & Pérez-Garcias, A. (2022b). Co-creating rubrics: students’ perspective on their process and the product designed in technology-enhanced learning environments. In J. M. Esteve & A. Fernández (Ed.), Transformando la educación a través del conocimiento (1152-1165). Editorial Octaedro. http://doi.org/10.36006/16410-1
Santana-Martel, J.S. y Pérez Garcias, A. (In Press). A Model of Assessment co-creation in Technology-Enhanced Learning Environments in Higher Education. Digital Education Review.
Stake, R. (2006). Multiple Case Study Analysis. The Guilford
Urbina, S., Villatoro, S., & Salinas, J. (2021). Self-regulated learning and technology-enhanced learning environments in higher education: a scoping review. Sustainability, 13(13): 7281. https://doi.org/10.3390/su13137281
van Karnenbeek, L., Janssen-Jansen, L., & Peel, D. (2022). Conceptualising co-creative planning pedagogies: The community knowledge triangle. Planning Practice & Research, 37(4), 446 - 463. https://doi.org/10.1080/02697459.2020.1856501
Thompson, J., Couzner, L., & Houston, D. (2020). Assessment partnerships from the start: Building reflective practice as a beginning paramedic student competency. Australasian Journal of Paramedicine, 17. https://doi.org/10.33151/ajp.17.750
Walters, S. R., Silva, P., & Nikolai, J. (2017). Teaching, learning, and assessment: Insights into students’ motivation to learn. The Qualitative Report, 22(4), 1151–1168. https://nsuworks.nova.edu/tqr/vol22/iss4/13
Zimmerman, B. J. (1990). Self-regulated learning and academic achievement: An overview. Educational psychologist, 25(1), 3–17. https://doi.org/10.1207/s15326985ep2501_2
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Jennifer Saray Santana Martel, Adolfina Pérez Garcías
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
1. The authors preserve their authorship and grant the Portuguese Journal of Education the right to the first publication. The work is licensed under Creative Commons Attribution License that allows sharing the work with the acknowledgment of initial authorship and publication in this Journal.
2. The authors have the right to take additional contracts separately, for non-exclusive distribution of the published version of their work (e.g. to deposit in an institutional repository or as a book chapter), acknowledging the initial authorship and publication in this Journal.
3. The authors have the permission and are stimulated to post their work online (e.g. in an institutional repository or on their personal website). They can do this at any phase of the editorial process, as it may generate productive changes, as well as increase impact and article citation (see The Open Citation Project).
The work is licensed under Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)
