How Erasmus University Rotterdam stimulated reflective group feedback in remote learning

Learning objectives

• Students are able to critically evaluate the whole process, including the group-work aspect

Learning activities

Over the course of six weeks, four groups of students addressed a real-life problem by designing the concept of a digital behavior change intervention to tackle the problem. Based on theoretical insights, data and information on the determinants of the problem, and an iterative user-centered design process, they work together to design a possible solution. The instructor gave minimal instruction as to what design choices should be made, aiming to open the process up to maximum creativity and innovative ideas.

After completing this project, group members gave anonymous feedback to each other based on a rubric, and carried out a self-assessment within the Group Member Evaluation tool. The rubric was based on several criteria: ability to communicate, accuracy of work, contribution, and attitude. On top of this, students were asked to leave specific feedback comments to their group peers. In an additional personal reflection, they evaluated what they had learned, how they felt about their own performance, what challenges they experienced, and how they responded to the feedback they received.

Learning activities based on the Bloom taxonomy are mainly at the level of:

Understanding‍

domain knowledge throughout the design process

Applying

theories, models and methods in the formation of a project plan and carrying out of process-related activities

Analyzing

data and information gathered throughout the project

Evaluating

the relevance, feasibility and applicability of insights and scientific implications derived from the collected data, and the process of the group project

Creating

a solution to the original real-life scenario in the form of a concept prototype of digital behavior change intervention

‍

Students were graded on a group portfolio which constituted 45% of their grade, of which 5% is based on the Group Member Evaluation activity. This grade is made up from mainly ratings received from group members, and the written self-reflection within the tool.

• The instructor was impressed that, despite it not being a large part of their grade, students often wrote genuine and personal reflections about their learning process.
• Knowing that they were being graded was reported to have increased their motivation and stimulated higher performance.
• Students were happy to be able to do a peer assessment, and all but one completed the activity on time.

"I really saw genuine reflections about their learning process. To be honest, I was impressed." - Dr. Marilisa Boffo, Assistant Professor, Erasmus University of Rotterdam

‍

The role of the instructor

• The instructor put extra attention towards setting up the course in Canvas in a way which was clear and comprehensive for students to understand. The complete learning trajectory, with goals, content, assessment, and any other useful information was available to be looked up within the LMS.
• On the first day of the course, the instructor took 15 minutes to present the whole course and show students where they could find particular information. In this session students were told how, where, and when feedback moments would take place, including the use of Group Member Evaluation.
• The student activity was checked inside of the tool during the last week of the course.
• Groups or individuals who were seen to be struggling with the course were asked to stop and complete a reflection after the end of a tutorial, and every group was given the possibility to complete an informal group evaluation together with the instructor halfway through the course.

Added value of technology

Group dynamics can be harder to keep an eye on in online courses when compared to face-to-face sessions. As well as making available a digital overview of peers’ grades and performance, Group Member Evaluation makes class management simpler for the instructor as every student’s self-assessment and feedback comments are available in one interface.

‍