External Reviewer Portal and Form Setup

Add and edit a review form to be used when reviewing an application form. Configure external reviewer portal settings.

The external reviewer portal is available as an add-on to all subscriptions.

Before assigning reviewers to applications, one or more review forms must be created for the application form in Admin Tools & Settings. This makes the review forms available to add to specific applications, and reviewers can then be assigned to complete a review form for those applications.

Settings for the external reviewer portal are also managed in Admin Tools & Settings. This includes setting the level of privacy for reviews between reviewers and configuring the overall rating scale to use on review forms.

Details on configuring the overall rating scale are available in the External Reviewer Portal Settings section. Only one scale can be configured to use across all review forms and the scale cannot be edited once in use. It is important to consider how this rating scale will be used before adding it to review forms and assigning reviews.

Add a Review Form

Add one or more review forms to an application form in Admin Tools & Settings. Once added, the form can be edited to build the fields reviewers will complete.

  1. Click the gear icon in the quick navigation menu.
  2. Click Grantee Portal & Reviewer Portal.
    Grantee Portal & Reviewer Portal option

  3. Click Grantee Portal Intake Forms to expand the section, and then click either Unsolicited Application Intake Forms or Invited Application Intake Forms and locate the relevant application form.
    Application intake forms dropdowns

  4. Click Add New Review Form.
    Add New Review Form button

  5. Complete the fields, and then click Next.
    1. Review Form Title - Enter a name for the review form, which is visible to assigned reviewers in the portal.
    2. Grantee Portal Intake Form - Select the application form that will be reviewed using this review form. 
    3. Amount to Display in Review Form - When a reviewer opens an assigned review, the name of the organization and the request title are displayed at the top of the page, along with an amount for the request. Select whether that amount should be the requested or recommended amount, or if no amount should be displayed.
    4. Review Form Inactive - If checked, this form will not appear in the list of available review forms for the application.Next button

  6. Edit the default email invitation settings as desired for this form, and then click Save.
    1. Edits can be made to this email when sending invitations to reviewers.Save button

The review form now appears in the Review Forms column next to the application form.

The Manage Review Forms section contains details on managing existing review forms. This includes the ability to configure due date notifications. The Edit a Review Form section contains details on editing the form to add content.

Edit a Review Form

Edit a review form to add or edit content. Once review forms are ready, they are available to add to specific applications and assign to reviewers.  

  1. Click the gear icon in the quick navigation menu.
  2. Click Grantee Portal & Reviewer Portal.
    Grantee Portal & Reviewer Portal option

  3. Click Grantee Portal Intake Forms to expand the section, and then click either Unsolicited Application Intake Forms or Invited Application Intake Forms and locate the relevant application form.
    Application intake forms dropdowns

  4. Click Edit next to the review form.
    Edit button

  5. Click Edit.
    1. The application form can also be edited here. To edit the review form, ensure that the Review button is selected.
      Edit button

  6. Click Add Page to add a new page to the review form.
    Add Page button

  7. Complete the fields, and then click Save
    1. The Introduction page is added by default and allows for limited customization, including adding an image or editing the page description. 
    2. Page Title - Enter a name for the page. This displays at the top of the page and in the navigation bar for reviewers unless a custom navigation label is entered.
    3. Custom Navigation Label - If desired, enter a name for the page to display to reviewers other than the page title.
    4. Conditionally Display This Page - If desired, configure this page to only display if a reviewer selects a specific option in a dropdown field from another page on the review form.
      Save button

Edit and manage pages in the navigation bar.

  • Click a page to view it and edit its content.
    Page name

  • Drag and drop pages into the desired order.
    Drag and drop icon

  • Click the gear icon next to a page to manage its settings.
    Gear icon

Content can be added and edited on each page. 

  • Click Add Image or Add Page Description to edit these components.
    Add Image and Add Page Description buttons

  • Click Add Field to add a new content field to the page.
    Add Field button

    • Click the type of field to add.
      • The Overall Rating Field adds a dropdown field for a reviewer to select from the rating scale configured in Admin Tools & Settings. This represents the reviewer’s overall scoring assessment of the application, and is used by the system to calculate average ratings for each reviewed application. This field can only be added once per form. Details are available in the External Reviewer Portal Settings section.
      • To add an additional dropdown field, select the Text field type, and then select Dropdown Menu as the answer type.
        Field types

    • Complete the fields, and then click Save.
      • Label - Enter the label to appear at the top of the field.
      • Required - Select Yes if the reviewer should be required to complete this field before submitting their responses.
      • Help Text - Optionally enter instructional text to appear below the field label.
      • Scheduled Display - If desired, schedule this field to only be displayed starting on a certain date or to be hidden starting on a certain date.
      • Conditional Display - If desired, configure this field to only display if a reviewer selects a specific option in a dropdown field elsewhere on the review form.Save button

    • Click a field to edit or delete it.Field

Click Preview to view the form as it will appear to an assigned reviewer. Preview button

Specific application pages can be hidden from reviewers when they are completing this review form. Since this is configured at the page level, it is not possible to hide only specific questions on a page.

  • Click the gear icon next to the application on the left-hand side of the page. Gear icon

  • Check the box to hide application pages from assigned reviewers completing this review form, and then click Update.Update button

Manage Review Forms

Manage existing review forms for an application form in Admin Tools & Settings.

  1. Click the gear icon in the quick navigation menu.
  2. Click Grantee Portal & Reviewer Portal.
    Grantee Portal & Reviewer Portal option

  3. Click Grantee Portal Intake Forms to expand the section, and then click either Unsolicited Application Intake Forms or Invited Application Intake Forms.Application intake forms dropdowns 

Multiple actions and options are available for managing the existing review forms.

  • Click Edit to add and edit content on a review form. The Edit a Review Form section contains details.Edit button

  • Click the trash can icon to delete the review form. 
    • This can only be done if the review form is not attached to any request records.
      • If the review form is attached to request records, it can instead be marked inactive.trash can icon
  • Drag and drop review forms into the desired order. 
    • This is reflected in the dropdown when selecting a review form to add to the application.Drag and drop icon

  • Click the dropdown icon to access additional options.Dropdown icon

    • Edit Properties - Edit basic details such as the review form title and whether requests’ requested or recommended amount is displayed on the form.
    • Edit Invitation Settings - Edit the default invitation email to send to reviewers assigned to this form.
    • Edit Confirmation Email Settings - Edit the email that is sent to reviewers when they submit this review form.
    • Edit Due Date Notification Settings - Email notifications can be configured to send to assigned reviewers before the due date and when reviews are overdue. These emails are only sent to reviewers who have not yet submitted their reviews. Click Add New Notification and configure when the email should be sent and the content of the email. 
    • Duplicate Review Form - Create a copy of the review form. The form can be added to any unsolicited or invited application form, and edits made to the new form do not affect the original. 

External Reviewer Portal Settings

The general external reviewer portal settings can be managed in Admin Tools & Settings. The overall rating scale for use on review forms can also be managed here.

  1. Click the gear icon in the quick navigation menu.
  2. Click Grantee Portal & Reviewer Portal.
    Grantee Portal & Reviewer Portal option

  3. Click Reviewer Portal Settings. Reviewer Portal Settings dropdown

Click the pencil icon next to a reviewer portal setting to edit it.pencil icon

  • Reviewer Portal Name - This name is visible when reviewers log into the portal. It is also visible at the top of the page once they are logged in.
  • Review Privacy - Select the privacy level for reviewers’ responses on review forms. This relates to responses from other reviewers assigned to complete the same review form for an application. 
    • Strict - Reviewers cannot view any other reviewers’ responses. 
    • Moderate - Reviewers can view other reviewers’ responses after submitting their own responses.
    • Flexible - Reviewers can view other reviewers’ responses at any time. 
  • Default Reviewer Portal Registration Email - Edit the default email to send when inviting a new reviewer to the portal from their contact record. This is not associated with a specific review form. Edits can be made to the email before sending.

Manage the overall rating scale for use on review forms. This rating scale is used in the Overall Score field that can be added to review forms. The system uses this scale to calculate the average score for reviewed applications. Since only one scale can be configured, it is important to ensure that the scale is applicable across all review forms.

The Edit a Review Form section contains details on adding this field to review forms.

Once this scale is in use, only the descriptive labels (e.g. "Strongly Recommend") can be edited. The numeric values cannot be changed and additional values cannot be added.

It is important to ensure that the scale is configured properly before adding it to review forms and assigning reviews. For example, once in use, the scale cannot be changed from a 3-point scale to a 5-point scale.

  • Click Add New Rating Scale Value to add a value option to the scale.Add New Rating Scale Value button

  • Click the pencil icon next to an existing value to edit it. pencil icon

  • Drag and drop values into the desired order.
    • This is reflected in the Overall Score field dropdown on review forms. Drag and drop icon