Solicitation Rating in OpenWater

Overview

Rating is completed by member company representatives using two separate processes. The first process allows the many internal stakeholders in a company to participate in the decision on selections in a secure, collaborative environment. This is handled by providing ratings and comments in a company-specific clone of the solicitation. It will be labeled with your company name. The second step is for the designated rater to submit the company's final selection decisions to the official SRC call.

Methodology
Advisory board members initiate the process
Advisory board members invite other raters
All raters collaborate online (or offline)
Advisory board members analyze collaborative ratings
Advisory board members submit official selections to SRC
Frequently Asked Questions

Rater Team Manager

Each company is assigned a single rater per solicitation. This person is called the Rater Team Manager. The rater team manager is responsible for

  • Communicating with internal stakeholders within their company
  • Providing links to internal stakeholders to use the OpenWater collaborative rating platform
  • Providing a single rating for their company to the SRC official solicitation

Rater team managers will have access to both the SRC official solicitation and a company-specific clone of the solicitation that can be used for internal collaboration. Rater team managers are solely in charge of providing access to the company-specific clone to their colleagues. This process happens outside of SRC.

 How does a Rating Team Manager add a rater to their team?

Find the invitation link by accessing the company-specific solicitation. The link will be at the top of the list of submissions. Send this link to any collaborators. When they follow the link, they will request to be added as a collaborative rater to your company-specific solicitation.

Once the link is opened in the browser, the rater will be prompted to log in or create an account if not logged in. Here is an example of what happens when you click on the invitation link and are not logged in.

shows an example of what happens when you click on the invitation link and are not logged in

If already logged in to OpenWater, then the user is asked to register for the rater signup (see example below). Once the Rater Signup form is submitted, an authorization email is sent to the Solicitation Coordinator for approval.

shows an example of what happens when you click on the invitation link and are logged in

Once the Rater Signup form is submitted, an authorization email is sent to the Solicitation Coordinator for approval. Approval should take less than 24 hours. 

Raters

Internal stakeholders at a company are welcome to participate as a rater using the OpenWater collaborative rating platform. An OpenWater account will be required for this. To be added as a collaborator on the company-specific solicitation, ask your voting Advisory Board member to send you the invitation link. 

Filter by Category

Raters can use the category filter to focus on submissions within a single category.

shows an example of what a submission looks like

 

Step 1. Collaborative rating using the company-specific clone solicitations

Log into the OpenWater platform

Choose 'My Rating Assignments' from the menu on the left. Find the solicitation you are looking for, and choose 'Open' under the Action header. Select a category or all categories. Click 'View Application' to select a specific application.

shows an example of viewing a list of submissions

 

shows an example of what a submission looks like

The submission will display a thumbnail of the document. If the thumbnail image does not work for you, there is a Download to PDF link on the page.

Shared Rater Comments

Shared rater comments are where internal team members can discuss a specific submission. These comments will not be shared with SRC. They are private to your company.

NOTE: You cannot enter Shared Rater Comments and a score at the same time. These actions should be performed in serial.

 

Step 1.5 Analyzing your company specific ratings

All raters are able to take advantage of a feature that allows you to see how others have rated a particular submission by clicking on See Other Rater Scores. This feature is only available in the company-specific clone solicitation.

example of where to click to see other scores

The Rater Team Manager is able to use the Rater Team Manager Panel in OpenWater. Find this in the local navigation and select the appropriate round.

Manage Raters

Here you can track the progress your raters have made on their assigned ratings. You do not actively manage raters using this panel; instead it's about what your team is doing.

Manage Raters: Export Scores

There are three different variations of this report.

  • Show score summaries only
    Spreadsheet of all raters with submissions that they have rated and the summary score. This gives you one row per submission, and a column for each rater.
  • Show all rating questions, scores and comments
    Same as above but with more detail about individual answers to each question and any comments. For this report, each row represents the intersection of a submission and a single rater.
  • Export rater conversations
    Instead of displaying scores, this is going to display the Shared Rater Comments for each submission. This helps you understand what people are saying about any particular submission.

Scores and Results: Judging Results

This is focused on the submissions rather than the people; it gives you a corporate view of the ratings. This includes an online grid which allows you to see scores by submission. This can be exported to allow you to manipulate the data.

 

Step 2. Official SRC Solicitation

Only the rater team manager will have access to the SRC Official call. This is where the final votes will be submitted.

Log into the OpenWater platform at https://src.secure-platform.com/a/organizations/main/home

Choose 'My Rating Assignments' from the menu on the left. Find the solicitation you are looking for, and choose 'Open' under the Action header. Select a category or all categories. Click 'View Application' to select a specific application.

shows an example of viewing a list of submissions

 

shows an example of what a submission looks like

The submission will display a thumbnail of the document. If the thumbnail image does not work for you, there is a Download to PDF link on the page.

Comments for SRC Program Managers

Comments left in this field will be shared with SRC.

 

Step 1 Alternative: Offline Collaboration

If you prefer to perform the evaluation and collaboration offline, you can. The rater team manager can download the Master Report and distribute this to internal stakeholders. This spreadsheet will contain the PI submission information as well as a link to the submissions. This file can be distributed to the internal stakeholders and will allow them to access the submissions.

shows where to find the master report

4819 Emperor Blvd, Suite 300 Durham, NC 27703 Voice: (919) 941-9400 Fax: (919) 941-9450

Important Information for the SRC website. This site uses cookies to store information on your computer. By continuing to use our site, you consent to our cookies. If you are not happy with the use of these cookies, please review our Cookie Policy to learn how they can be disabled. By disabling cookies, some features of the site will not work.