Effective Efficient Grading Guide
Instructional Design Recommendations
Eliminate high stakes exams -- consider using multiple, short assessments
Implement more project-based deliverables to replace high stakes exams
Replace multiple choice questions with short answer or essay
Randomize the order of the questions and the order of the answers within a question, and if appropriate, generate different values for variables
Use multiple types of assessments, e.g. short quizzes, forums, polling, papers, group activities
Utilize the services of plagiarism checker software like Turnitin for short answer or essay questions, or perhaps even forum postings
Utilize the services of either an online, like ProctorU, or face-to-face proctoring service
Have a clear Code of Conduct or academic integrity statement in the syllabus
Consider a brief evaluation of student knowledge to be used as a baseline prior to introducing a specific topic
Course Management Recommendations
- Create a large pool of questions
- Randomize questions and distractors
- Implement a time limit on each exam or quiz
- Include open-ended or essay questions
- Require students to submit quiz answers immediately and overnight any supporting work done on paper
- Consider grading student contributions to course forums (discussion boards)
- Call attention to the “Academic Integrity” block that is located on every course site at the beginning of the semester
- Be explicit about what behaviors are allowed and not allowed during an online activity, especially if they vary
Library Guide to Designing Research Paper Assignments
http://libraryguides.lehigh.edu/citlworkshop_assignments
| Think beyond the exam. There are many ways to assess student learning: | ||
| case write ups computer case simulations online interactive testing faculty feedback during task performance | formal presentations of cases formalized faculty observations journaling laboratory report | multiple choice examinations observation of skills oral exams one-minute essay |
| presentations procedure logs reading quiz self-reflection | short essays or reports simulations video projects/digital storytelling written exams | papers peer feedback and evaluation performance checklists portfolio |
Assessment Recommendations
QUESTION RULES | DESCRIPTION/ EXAMPLE |
Questions must focus on objectives | Focus questions on what you most want people to know at the end of course. Avoid testing trivial topics. |
Questions should assess knowledge or skill | Focus on content. Write questions clearly with correct grammar and spelling. Consider the reading level. |
Incorrect choices must be plausible | Good multiple choice questions have realistic incorrect answer choices. Avoid giveaway choices |
Use Question Words | Begin question stems or phrases with a question word. Examples: Correct: How often does a student need to attend to get a good grade? Correct: If a student has a concern, what is the first step in addressing his/ her concern? Incorrect: Select two (2) features of… |
Objectives Drive Questions | A question should reflect the objective. If an objective involves problem-solving, then test question should involve problem-solving. For example, a problem-solving question might provide a scenario. |
Avoid Negatives in Stem | Phrase the question stem in the positive. Examples: Correct: A student has not been given correct information. What could you do to address the problem? Incorrect: When writing good questions, which of the following is NOT important? |
Use Scenarios to assess higher-order thinking | Ex- Correct: Given the scenario shown, which solution represents the best method for preventing patient falls? |
Limit number of answer choices | Use consistent number of answer choices. Limit to 3 or 4. Do not create questions in which all answers are correct |
Use plausible distracters | Distracters should not include give away answer Distracters should be plausible Identify common misconceptions or errors |
Design Evaluation | |
Create test questions that align with your stated objectives and test the level of comprehension desired. | Multiple choice questions: test knowledge, comprehension, application, and analysis. They are limited because they can be less valid due to guessing and poor distracters True/False questions: are easy to score and quick to complete for the learner. Because there is a 50% chance of selecting the correct answer, they are not as valid as other forms of assessment. Short answer and matching questions: Save space and test information similar to multiple-choice, but may take longer to score. Essays: Test higher level skills and give insight into learner’s understanding. Essays test only focus on a few concepts, and take longer to complete and score. |
Writing Questions
Please write questions that correspond with each of your learning objectives. At least 10 questions will be pulled from a “test bank” to ensure each learner has a unique test. The more questions you write for the “test bank”, the greater the variety will be between tests and the more difficult it will be for users to cheat.
Consider writing your test questions in the form of a scenario. Placing the content into a real world context will test your students on how they will be able to apply the information.
You may write your test questions in the following formats:
- True/False
- Disadvantages to using True/False question format: learners have a 50/50 chance of guessing the correct answer; they are easy; it is difficult to determine if learners really know the material
- Tips for writing True/False:
- Avoid double negatives
- Avoid long or complex sentences
- Use one central idea
- Avoid words like always, never, all
- Don’t try to trick the learner
- Multiple choice
- Avoid negative statements (for example: “Select the item that is Not…” or “All of the following EXCEPT…”)
- Avoid using “All of the above” or “None of the above”
- 4-5 options should be given as responses
- Make sure that all response options are plausible (don’t make it obvious that an option is correct or incorrect)
- Multiple response
- Multiple response questions allow learners to select more than one option
- State clearly in the question that the learner can select more than one (for example: “Select the three items…”)
- Fill in the blank
- Make sure that the answer is definite (not something that can be interpreted differently, or something that may have multiple correct responses)
- You can enter up to 10 acceptable answers in the system to account for different user responses (take into account spelling differences, etc.)
- Matching
- You may have up to ten matching pairs
- Sequence
- Learners must put items into the correct sequence
- You may have up to ten items to put into sequence
- Hotspot
- Ask the learner to click on the correct area within an image.
Most of the recommendations above will benefit F2F classes and could be implemented for various modes of course delivery.