Online Assessment Best Practices

Effective Efficient Grading Guide

https://drive.google.com/file/d/0BweyDzCgDfTyc3Y0eUxUZW0temc/view

Think beyond the exam. There are many ways to assess student learning:
case write ups computer case simulations online interactive testing faculty feedback during task performance	formal presentations of cases formalized faculty observations journaling laboratory report	multiple choice examinations observation of skills oral exams one-minute essay
presentations procedure logs reading quiz self-reflection	short essays or reports simulations video projects/digital storytelling written exams	papers peer feedback and evaluation performance checklists portfolio

Instructional Design Recommendations

Eliminate high stakes exams -- consider using multiple, short assessments
Implement more project-based deliverables to replace high stakes exams
Replace multiple choice questions with short answer or essay
Randomize the order of the questions and the order of the answers within a question, and if appropriate, generate different values for variables
Use multiple types of assessments, e.g. short quizzes, forums, polling, papers, group activities
Utilize the services of plagiarism checker software like Turnitin for short answer or essay questions, or perhaps even forum postings
Utilize the services of either an online, like ProctorU, or face-to-face proctoring service
Have a clear Code of Conduct or academic integrity statement in the syllabus
Consider a brief evaluation of student knowledge to be used as a baseline prior to introducing a specific topic

Course Management Recommendations

Create a large pool of questions
Randomize questions and distractors
Implement a time limit on each exam or quiz
Include open-ended or essay questions
Require students to submit quiz answers immediately and overnight any supporting work done on paper
Consider grading student contributions to course forums (discussion boards)
Call attention to the “Academic Integrity” block that is located on every course site at the beginning of the semester
Be explicit about what behaviors are allowed and not allowed during an online activity, especially if they vary

Library Guide to Designing Research Paper Assignments

http://libraryguides.lehigh.edu/citlworkshop_assignments

Assessment Creation Recommendations

QUESTION RULES

DESCRIPTION/ EXAMPLE

Questions must focus on objectives

Focus questions on what you most want people to know at the end of course. Avoid testing trivial topics.

Questions should assess knowledge or skill

Focus on content.

Write questions clearly with correct grammar and spelling.

Consider the reading level.

Incorrect choices must be plausible

Good multiple choice questions have realistic incorrect answer choices. Avoid giveaway choices

Use Question Words

Begin question stems or phrases with a question word.

Examples:

Correct: How often does a student need to attend to get a good grade?

Correct: If a student has a concern, what is the first step in addressing his/ her concern?

Incorrect: Select two (2) features of…

Objectives Drive Questions

A question should reflect the objective.

If an objective involves problem-solving, then test question should involve problem-solving.

For example, a problem-solving question might provide a scenario.

Avoid Negatives in Stem

Phrase the question stem in the positive.

Examples:

Correct: A student has not been given correct information. What could you do to address the problem?

Incorrect: When writing good questions, which of the following is NOT important?

Use Scenarios to assess higher-order thinking

Ex- Correct: Given the scenario shown, which solution represents the best method for preventing patient falls?

Limit number of answer choices

Use consistent number of answer choices.

Limit to 3 or 4.

Do not create questions in which all answers are correct

Use plausible distracters

Distracters should not include give away answer

Distracters should be plausible

Identify common misconceptions or errors

Design Evaluation

Create test questions that align with your stated objectives and test the level of comprehension desired.

Multiple choice questions: test knowledge, comprehension, application, and analysis. They are limited because they can be less valid due to guessing and poor distracters

True/False questions: are easy to score and quick to complete for the learner. Because there is a 50% chance of selecting the correct answer, they are not as valid as other forms of assessment.

Short answer and matching questions: Save space and test information similar to multiple-choice, but may take longer to score.

Essays: Test higher level skills and give insight into learner’s understanding. Essays test only focus on a few concepts, and take longer to complete and score.

How to Build Good Questions

Please write questions that correspond with each of your learning objectives. At least 10 questions will be pulled from a “test bank” to ensure each learner has a unique test. The more questions you write for the “test bank”, the greater the variety will be between tests and the more difficult it will be for users to cheat.

Consider writing your test questions in the form of a scenario. Placing the content into a real world context will test your students on how they will be able to apply the information.

You may write your test questions in the following formats:

True/False
- Disadvantages to using True/False question format: learners have a 50/50 chance of guessing the correct answer; they are easy; it is difficult to determine if learners really know the material
- Tips for writing True/False:
  - Avoid double negatives
  - Avoid long or complex sentences
  - Use one central idea
  - Avoid words like always, never, all
  - Don’t try to trick the learner
Multiple choice
- Avoid negative statements (for example: “Select the item that is Not…” or “All of the following EXCEPT…”)
- Avoid using “All of the above” or “None of the above”
- 4-5 options should be given as responses
- Make sure that all response options are plausible (don’t make it obvious that an option is correct or incorrect)
Multiple response
- Multiple response questions allow learners to select more than one option
- State clearly in the question that the learner can select more than one (for example: “Select the three items…”)
Fill in the blank
- Make sure that the answer is definite (not something that can be interpreted differently, or something that may have multiple correct responses)
- You can enter up to 10 acceptable answers in the system to account for different user responses (take into account spelling differences, etc.)
Matching
- You may have up to ten matching pairs
Sequence
- Learners must put items into the correct sequence
- You may have up to ten items to put into sequence
Hotspot
- Ask the learner to click on the correct area within an image.

Most of the recommendations above will benefit F2F classes and could be implemented for various modes of course delivery.