Hybrid Digital and Traditional Assessments in The Assessment-as-Learning Framework
Abstract
The increasing integration of digital technologies in higher education has transformed assessment practices and encouraged the adoption of Assessment-as-Learning (AaL), which emphasizes reflection, self-monitoring, and learner autonomy. Despite the growing popularity of digital assessment, empirical evidence comparing its effectiveness with traditional assessment in promoting student engagement remains limited. This study investigated whether digital and traditional assessment modalities produce different levels of cognitive engagement when implemented within an AaL framework. A quantitative counterbalanced repeated-measures design was employed involving 72 undergraduate students enrolled in an Educational Evaluation course at a public university in Indonesia. Participants completed both traditional and digital assessment activities addressing equivalent learning objectives. Cognitive engagement was measured using an adapted version of the Student Engagement Instrument (SEI) focusing on the Control and Relevance of School Work dimension. Descriptive statistics, Shapiro–Wilk tests and paired-samples t-tests were conducted using IBM SPSS Statistics 25. The results indicated high levels of cognitive engagement under both traditional (M = 3.92, SD = 0.59) and digital assessment conditions (M = 3.76, SD = 0.64). However, the difference was not statistically significant, t(71) = 1.901, p = .061, with a small effect size (d = 0.22). These findings suggest that assessment modality alone does not significantly influence cognitive engagement. Instead, pedagogical elements embedded within the AaL framework appear to play a more important role in supporting meaningful learning. The study provides empirical support for hybrid assessment models that combine digital and traditional approaches while maintaining a strong focus on reflective and learner-centered assessment design.
Keywords
Full Text:
PDFReferences
Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006). Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument. Journal of School Psychology, 44(5), 427–445.
Bergdahl, N., Bond, M., Sjöberg, J., Dougherty, M., & Oxley, E. (2024). Unpacking student engagement in higher education learning analytics: a systematic review. International Journal of Educational Technology in Higher Education, 21(1), 63.
Black, P., & Wiliam, D. (1998). Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74.
Boud, D., & Molloy, E. (2013). Rethinking models of feedback for learning: the challenge of design. Assessment & Evaluation in Higher Education, 38(6), 698–712.
Earl, L. M. (2012). Assessment as learning: Using classroom assessment to maximize student learning. Corwin press.
El Msayer, M., Bouihi, B., Bousselham, A., Aoula, E., & Deraoui, A. (2026). Designing Formative Adaptive Assessment for Engineering Education: Integrating Computerized Adaptive Testing and Competency-Based Diagnostic Modelling. International Journal of Engineering Pedagogy (IJEP), 16(1), 133–154.
Firmansyah, A., Samsudin, A. F., Aqmal, R. Y., Sasmita, A. H., & Dwiyanti, V. (2021). E-learning methods impact in vocational education. INVOTEC, 17(1), 14-21.
Fredricks, Jennifer A, Blumenfeld, Phyllis C, & Paris, Alison H. (2004). School Engagement: Potential of the Concept, State of the Evidence. Review of Educational Research, 74(1), 59–109.
Ifenthaler, D., Schumacher, C., & Kuzilek, J. (2023). Investigating students’ use of self-assessments in higher education using learning analytics. Journal of Computer Assisted Learning, 39(1), 255–268.
Johar, N. A., Kew, S. N., Tasir, Z., & Koh, E. (2023). Learning analytics on student engagement to enhance students’ learning performance: A systematic review. Sustainability, 15(10), 7849.
Laaziz, Y., Chemsi, G., & Radid, M. (2024). The Influence of E-Assessment on Students’ Cognitive Engagement in Higher Education. International Journal of Engineering Pedagogy (IJEP), 14(4), 54–67.
Lim, K. (2024). Assessing beyond grades: unravelling the implications on student learning and engagement in higher education. Assessment & Evaluation in Higher Education, 49(5), 665–679.
Karpin, K., & Mahmudatussa'adah, A. (2022). Learning Reflections to Build Learner Autonomy. INVOTEC, 18(1), 32-40.
Martinez, C., Serra, R., Sundaramoorthy, P., Booij, T., Vertegaal, C., Bounik, Z., van Hastenberg, K., & Bentum, M. (2023). Content-Focused Formative Feedback Combining Achievement, Qualitative and Learning Analytics Data. Education Sciences, 13(10).
Mohammadi Zenouzagh, Z., Admiraal, W., & Saab, N. (2025). Empowering students’ agentive engagement through formative assessment in online learning environment. International Journal of Educational Technology in Higher Education, 22(1), 9.
Nicol, D. J., & Macfarlane‐Dick, D. (2006). Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218.
Panadero, E., Broadbent, J., Boud, D., & Lodge, J. M. (2019). Using formative assessment to influence self- and co-regulated learning: the role of evaluative judgement. European Journal of Psychology of Education, 34(3), 535–557.
Permana, H., & Haritman, E. (2024). Determining priority criteria for using online learning media in Emergency Remote Teaching (ERT) using the Analytical Hierarchy Process (AHP) method. INVOTEC, 20(1), 58-66.
Pratiwi, A. I., Abdullah, A. G., & Mukhidin, M. (2023). Unlocking the potential of vocational skills: How vocational high school students' preferences for teachers' use of digital technology influence telecommunication technical skills. INVOTEC, 19(2), 135-143.
Ramaswami, G., Susnjak, T., & Mathrani, A. (2023). Effectiveness of a Learning Analytics Dashboard for Increasing Student Engagement Levels. Journal of Learning Analytics, 10(3), 115–134.
van der Linden, J., van der Vleuten, C., Nieuwenhuis, L., & van Schilt-Mol, T. (2023). Formative Use of Assessment to Foster Self-Regulated Learning: the Alignment of Teachers’ Conceptions and Classroom Assessment Practices. Journal of Formative Design in Learning, 7(2), 195–207.
Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018). The current landscape of learning analytics in higher education. Computers in Human Behavior, 89, 98–110.
Yan, Z., Li, Z., Panadero, E., Yang, M., Yang, L., & Lao, H. (2021). A systematic review on factors influencing teachers’ intentions and implementations regarding formative assessment. Assessment in Education: Principles, Policy & Practice, 28(3), 228–260.
Zainuddin, A., Wasis, Ekohariadi, Anistyarsari, Y., Rijanto, T., & Habibi. (2026). A systematic review of digital assessment trends in education from 2015-2025. Multidisciplinary Reviews, 9(9), 2026433.
DOI: https://doi.org/10.17509/invotec.v22i1.98178
Refbacks
- There are currently no refbacks.
Copyright (c) 2026 Ayu Permata Sari, Muhamad Akda Fathul Barri, Rizki Hikmawan, Haruki Miyahara

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
This journal provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge.

This work is licensed under a Lisensi Creative Commons Atribusi-BerbagiSerupa 4.0 Internasional.


