Join our Webinar on December 17th: From Regulation to Innovation: What the EU AI Act Means for EdTech
chevron_right

How Wageningen University improved online discussion quality by grading students' best contribution

Ananda Verheijen
|
July 29, 2020
DOMAIN
STEM
Class Size
160
Instructor Workload
Learner Workload
ABOUT THE INSTITUTION
ABOUT THE INSTRUCTOR(S)
ABOUT THE INSTITUTION
ABOUT THE INSTRUCTOR(S)

Context

This bachelor course from a Food Technology programme introduces bachelor students to the principles of food quality management over four weeks. Each week, groups of four students study this topic from a different angle, resulting in a report prepared by the whole group. Researchers at Wageningen University & Research and the team at FeedbackFruits opted to enable a beta function of Peer Review: Participation Grading. This involves grading only the ‘best contribution’ that students themselves provide for the peer review assignment.

A research project exploring the feature was carried out across several other courses. The use of the Peer Review tool and the implementation of the newly designed approach, Best Contribution Grading (BCG) had four aims: to increase the quality of peer reviews; to increase student participation, to offer a safe learning environment; and to deliver a scalable teaching method.

Learning journey
Gamified peer review
A framework to integrate game design elements into peer review for enhanced engagement and critical thinking
access now
Learning journey
Self-assessment for learner engagement
A framework to integrate game design elements into peer review for enhanced engagement and critical thinking
access now
Learning journey
Developmental portfolio for lifelong learning
Promote skills transfer and career readiness through technology-enhanced student portfolios
access now

Learning objectives

  • Students develop problem-solving skills by means of analysing the work of others.
  • Students are able to diagnose problems, identifying areas for improvement and suggesting solutions in the area of food quality management.

Learning activities

Students produce and upload a report as a group, and individually give feedback to the work of another group using Peer Review. After giving feedback, students are asked to select those contributions (feedback comments) that they themselves judge as their best piece of work for the instructor to grade. As students select their best contributions themselves, this guarantees that their errors or mistakes do not influence their course grades as long as they do not select those as their best contribution.

Learner activities based on the Bloom taxonomy are mainly at the level of:

  • Evaluating - students’ own comments and contributions given inside Peer Review to select their best ones.
  • Analysing - and evaluating the reports of others and giving feedback

Assessment of learning outcomes

BCG was used to assess students’ learning.  Students’ contributions come in the form of qualitative review comments. The students make numerous comments on each other’s work and choose themselves which comments they’ve made which they think best represents their work and abilities. These chosen comments are relayed to the instructor whereupon they are assessed for adherence to the grading rubric.

Notable outcomes

  • Using Peer Review provided students with a safe learning environment in which they felt free to give feedback and contribute to online discussions without each comment being judged or graded by allowing students to select the comments they themselves wanted to be assessed.
  • An overall positive effect on student satisfaction was reported after using the BCG system.
  • The quality of students’ contributions was higher and students were able to take charge of their own assessment.
  • The instructor found that the tool offered support for all the desired outcomes of using Peer Review with the BCG system.

The role of the instructor

  • The instructor first sets up instructions for the students inside the platform, which lets them know that their feedback is graded based on what they themselves select as their best feedback provided to peers. 

  • Over the course, the instructor can see which work has been handed in and which students have submitted their best contribution feedback for review.
  • After everyone has submitted their best contribution for grading, the instructor can give a grade from 1 to 10.
  • The instructor can take the context, such as the original product and reviews, and replies from others into account when grading students’ comments. Instructors can determine the number of contributions students need to identify as being their best ones.
  • After grading all comments from students, they can be sent to students after which those students are no longer able to change their selected comments. It is still possible to change the grade of a student afterwards, in which case it will be automatically sent out to that student.

Added value of technology

  • Using the tool in this way creates a safe learning environment for students, where they can learn by making mistakes and errors as well as asking questions without feeling every action is being graded.
  • The BCG feature was co-created with the WUR to enrich the possibilities within Peer Review. FeedbackFruits optimised both the selection of the best contribution(s) and the grading process.
"Students felt they had improved their understanding of the topic by giving feedback using BCG." - Dr. Cora Busstra, Teacher & Instructional Designer, Wageningen University & Research

Possible variation

The instructor can opt to require a different number of contributions per student and explain what is expected in the instructions field. Choosing whether to set a deadline and whether late hand-ins are allowed can encourage students to hand in their work on time while also accepting late work, with a chosen penalty.

Share on social media

Recommended use cases

Learn how NHL Stenden made the transition from traditional portfolios to a streamlined, user-friendly approach that enables students to concentrate more fully on learning

Learn how instructors at ESSEC Business School utilized pedagogical tools and AI to transform formative assessment in large student cohorts

Discover how instructors at Reyjkavic University used gamification to enhance the peer review process

We gather the most valuable resources and learnings on pedagogy and email them to you every month.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Filling out this form means you agree to our Privacy Policy.