The Reviewer Group Template holds the basic information upon which all Reviewer Groups can be established. It contains:

  • The default Reviewer Note
  • The default questions and rubrics available for reviewers to use when evaluating applications
  • A list of all users with access to the Reviewer portal--reviewers and reviewer chairs
Any changes made to the Reviewer Group Template will be reflected on all "attached" reviewer groups. Review Groups that have been detached (you have made changes to them in order to make them separate from the template) will not be affected.
 

The Details Tab
The Reviewers Tab
The Questions Tab
The Rubrics Tab

 

The Details Tab

The Details tab contains the Reviewer Note. This note will be displayed at the top of the scoring rubrics and questions that reviewers encounter when evaluating every application or applicant in your system. You may wish to use the Reviewer Note to remind reviewers of standards; to provide guidance on how to select appropriate candidates; or simply to provide contact information for someone in your institution or organization to contact with questions. Be sure to click the green "Update" button when finished to save your changes.

 

The Reviewers Tab

This tab displays all users with reviewer permissions in your system as well as which groups they work in, the total number of visible assigned evaluations, and the total number of completed evaluations they have submitted. How do I add or remove reviewers?
  • Reviewed - Number of application reviews the user has submitted (this number does not include saved drafts of reviews).
  • Assigned - All Groups - Number of applications assigned to this user that are visible to them inside their Reviewer Portal. (If the user belongs to more than one reviewer group, this is the accumulated total from all assignments made by all groups.)
 

The Questions Tab

The Questions tab is where you may include a series of questions that will be asked of your reviewers. Just as when building questions for applicants or reference providers, you have a wide range of possible question types to direct towards your reviewers. 

Example questions:

  • "Why do you feel this applicant is the best choice? 
  • "Do you have any concerns about this applicant?
  • "Yes or No: Has this applicant satisfactorily met all requirements for this scholarship?"
To add a question:
  • Select Opportunity > Evaluators > Group Template.
  • Select the Questions tab.
  • Click Add Reviewer Question. This will launch the question creation screen.
  • Creating a New Question (or Set)
    • Type in the question (or question set name) into the Question box.
    • Click Single Question to make just one question or Question Set to begin creating a question set.
    • For a single question, enter the question text, select the question type, and enter a maximum word count (if applicable).
    • For a question set, enter the question set text, add the subsequent question(s) text(s), select the question type, and enter a maximum word count (if applicable). Click Add Another Question to this Set to enter your additional questions.
    • Click Save Question. 
Adding an Existing Question to the Template
To add an existing question (including one you just created) to the reviewer group template, click the + button next to the question. Close the question window, and click Update Questions. 
  • Order: Use the gray bars to drag-and-drop questions to re-order questions.
  • Required: Mark the box Required? to require that a reviewer provide some response before successfully completing an evaluation.
  • Edits: Click the Edit button next to the question to edit the question and/or answers.
  • Removal: Remove a question from the template by clicking on X button beside the question.
 

The Rubrics Tab

The rubrics tab is extremely important for the review process, as this allows you to determine the default scoring rubrics that will be used by reviewers to generate a score for all applications (or applicants). You can detach a review group in order to have different rubrics for a group.

To create a new scoring rubric, select the Rubrics tab, click Create Rubric, and enter the needed information. 

  • Name - The text or label of the rubric.
  • Min Score - The lowest score possible.
  • Max Score - The highest score possible. 
  • Offset - The intervals between scores. For example, an offset of "1" allows 1, 2, 3,4, etc. and an offset of "2" allows 2, 4, 6, 8, etc.
  • Weight - If there is an element you would like to carry more overall importance (such as Financial Need or Unusual Circumstances), you may "weight" it by a multiplying factor so that it produces a larger number (and thus raises the overall score for the application/applicant). Please Note: The Weighting number is the multiplying factor onlyIt does not calculate percentage value of the total overall score (ie, if you enter 10 it will not mean this score accounts for 10% of the 100% of the student's overall score. It will simply multiply whatever score is selected times 10.) For example, if a reviewer assigns a student a 3 for Financial Need and that rubrics has a Weight of 2, then the student actually receives a 6 for Financial Need. The 6 is then added together with the other rubric scores to produce a sum total.
To edit a created rubric:
  • Click Edit beside the name of the rubric.
  • Make any necessary changes.
  • Click Update Rubric.

To disable a rubric: 

  • Click Edit beside the name of the rubric.
  • Unmark the Enabled box.
  • Click Update Rubric.