In the previous article, we went into the nitty-gritty of rubrics, why we use them, the shift from teacher-centered to a student-centered approach, and the different types of rubrics and their ideal use cases. Now we are going to dive into methods for creating quality rubrics that can help meet these criteria.
Before we really dive into the methods, it can be helpful to go over the common misconceptions surrounding rubrics, so we can avoid them :
Approaching the creation of rubrics for courses or assignments can be intimidating and can vary depending on the type of rubric you choose to use. Regardless of the chosen rubric, most processes can be boiled down to similar elements :
To help explore this process we’ll dive into some different approaches, this is by no means an exhaustive list but does provide a good starting point.
First, we’ll consider the adaptation of already existing rubrics, and then dive into how we can create rubrics from scratch, specifically using the bottom-up approach.
Time is precious and understanding the key components of rubrics, and what constitutes a good rubric in different scenarios can be helpful in recognizing good rubrics that can be adapted for your teaching. The approach sometimes called Adopt and Adapt, literally means adopt a rubric you found online, or that was shared by your colleagues, and adapt it to your teaching context.
If you find a rubric, say for a research paper, then there are a few steps you can take to best adapt it to your and your student’s needs.
Step 1: Consider the assessment task and the context in which the rubric will be applied
Step 2: Evaluate whether the criteria can be kept as they are, for example, a criterion on “Synthesis and Evaluation” may still be relevant for your learning outcomes on your research assignment too.
Step 3: Consider whether the description level performances of the criteria in the rubric you found suit your particular learning context.
In general, the process of adapting rubrics should be iterative over time. This means it is helpful and important to monitor how students are progressing over time, and how performance levels are changing. In this way, rubrics can be kept reliable and useful.
Ragaputhi and Lee suggest in their book chapter on rubrics, that a good starting place to test the adapt and adopt approach could be the VALUE rubrics provided by the American Association of Universities and Colleges.
Constructing a rubric from scratch can be a tough process. In their book on educational assessment Anthony Nitko and Susan Brookhart outline two valuable methods that can help scaffold the process of constructing rubrics to facilitate positive outcomes, these are called the top-down approach and bottom-up approach. In this case, we’ll focus on the bottom-up approach, but know that the top-down approach may be a good fit if instructors know what skills the course requires students to develop, and what levels of performance of these skills determine success. You can read more about this approach in the book linked above.
The bottom-up approach is an inductive process, which begins by sampling student work and using them to create a framework for assessment. This is best to use when still defining the descriptions of content and performance, or when you intend to involve students in defining their own criteria. The process is as follows:
In our previous article on rubrics, we highlighted that there are two main components to rubrics, the criteria and the description of success across levels for each criterion. No matter the type of rubric, they will at least include some form of these two components. So to ensure the success of the rubrics that we formulate, whether that be adapting or constructing from scratch, understanding what makes up good criteria and performance level descriptions is key.
Susan Brookhart provides us with a good list of recommendations for good criteria and performance level descriptions in her book on rubrics for formative education and assessment.
Let’s start with the criteria. They should be :
1. Appropriate: Each criterion should represent an aspect of the goal or objective that we intend for students to learn, for example, if it's teamwork, their contributions to the team's work may be a relevant criterion.
2. Definable: It is important that each criterion consists of clear and agreed-upon meaning, that both teachers and students understand. Often times a major problem with rubrics can be students failing to understand what teachers really mean , so make sure that the criteria are simple and use terms that all students understand.
3. Observable: Criteria are used to guide judgement on learning, so to be useful and valid they should be something that teachers or anyone reviewing the work can observe. This could be in the form of behaviour in teamwork, for example, inclusivity, or it could be something visible in their work, such as argumentation.
4. Distinct: It is important that each criterion is unique, if we cannot distinguish between them they lose part of their value. It also becomes more difficult for students to assess and differentiate their learning progress if criteria overlap.
5. Complete: Each criterion on its own may not represent the learning outcomes intended, but when taken all together the criteria should represent all the areas of learning and skills that we aim to foster in students.
6. Support descriptions along continuums: It should be possible to describe the criteria over a range of levels, if this is not feasible then the criteria may not be ideal for use.
With the criteria established, the next part is to write the descriptions of performance. When starting off the descriptions, you can ask yourself “what does student performance on this criterion look like ranging from high to low?”  These levels should be on a continuum, and it’s important that the differences between these levels can be described precisely.
The descriptions of performance should be:
Descriptive: Performance is described in terms of what is observed in the work. Avoiding evaluative language is key. Instead of saying the student has excellent communication skills, try to break down what that actually means.
Clear: As highlighted above, mutual understanding of the criteria and descriptions for students and teachers is key to success.
Cover the whole range of performance: Performance is described from one extreme of the continuum to another for each criterion.
Distinguish among levels: It is important that the descriptions betweens levels are different enough so that there isn’t space for much ambiguity on both student and teacher's side when matching examples of work to performance descriptors.
Matching the target performance to the appropriate level: Make sure that the description of performance level is an appropriate level that one can expect from students, given the goal of the lesson, assessment or curriculum. Moreover, each description of level should be placed at the intended level on the rubric (developing, proficient, exemplary).
Feature parallel descriptions from level to level: Across the rubric for each criterion, there should be descriptions of performance, this should represent a continuum ranging from low to high.
Creating rubrics is no easy task, from deciding which type of rubric to use, to deciding on the relevant criteria, and describing the levels of performance from high to low on each of the criteria.
From this article we hope to have made you aware of the most common misconceptions about rubrics, and how we can avoid those by scaffolding the rubric creation process, through adopting and adapting, or even by constructing the whole rubric from scratch, through the bottom-up approach.
With the continued use of effective rubrics, we can help students start to notice recurring patterns in their learning, including strengths and more troublesome areas. And through this reflection and monitoring of learning, we encourage students to become active participants in their learning.
Discover how to maintain continuous student engagement at every stage of your course using Interactive Document
Explore how to best implement active learning strategies with deep understanding of different modalities
FeedbackFruits announces partnerships with many institutions worldwide over the past 4 months