Editing your allocation
Once the system completed the automatic allocation you can change your allocation manually and reassign a submission to a reviewer on your review list of submissions.
Step 1) Go to your review list
You can access this list by clicking on the View Submissions prompt from the card on your dashboard:
It will take you to Review list where you can start making reassignments:
Step 2) Choose a reviewer to reassign
To change a reviewer you should click on the name of the reviewer or on the empty reviewer slot (No Reviewer) that you wish to reassign (as shown by the red arrow):
Step 3) Choose an option
Once you click on the reviewer's name/empty slot, you will be presented with a screen that will ask you, "Who should review this paper?"
You will have 4 options to choose from:
- Recommended Reviewers: Choose one of the "recommended reviewers" as determined by Ex Ordo's statistical analysis of the underlying submission and available reviewers. You will see their rating as a reviewer (their topic match to the submission) as well as their workload (how many submissions they are currently reviewing).
- Search by Name or Email: Browse or search the list of reviewers available to you.
- Invite a Reviewer: Invite an external reviewer that is not currently available in the list of reviewers. This is useful if you would like to invite a colleague that has not yet been invited to be a reviewer for this conference.
- No Reviewer: For whatever reason, you may decide to leave one of the review slots vacant. Choose this option, if you want to remove a reviewer from this submission's panel of reviewers.
a) Choose a recommended reviewer
Based on our statistical analysis of the underlying submission, the system will present a list of 3 "recommended reviewers". It should be stressed that our recommendation engine does not take into account a reviewer's intellectual ability, reputation or academic qualifications. Instead, it bases its recommendations on the statistical analysis of a paper vs. the available reviewers.
You are guaranteed that a recommended reviewer; will be a reviewer with the highest relevance to the paper, will not be overburdened with review assignments and will not have an identified conflict of interest with the submission.
If you are not satisfied with the reviewers recommended, you should choose the "Search by Name or Email" option instead.
b) Search by name or email
You can choose to search by name/email or browse the list of available reviews. If you select this option, you will be presented with a screen that looks something like this:
Search
In the top right hand corner, you can use the search engine to search through the list of available reviewers. Using this tool, you can enter the reviewer's first name, last name, organisation or email address. The system will perform a search for you in realtime and present the results as above.
List of Reviewers
You can also choose which list of reviewers you want to search/browse using the drop down option in the right hand corner of the screen. You can choose to search by all reviewers, recommended reviewers, related reviewers or conflicted reviewers.
Star Rating
Each reviewer is given a "star rating" based in his/her suitability for the given submission. This rating is based on the number of topics shared between the reviewer and the submission. A reviewer with 3 stars, has the maximum number of common topics shared with the submission. A reviewer with no stars, has no topics shared with this submission. The star rating does not take a reviewer's intellectual ability, reputation or academic qualifications into account.
Workload
Each reviewer also has a "workload" rating, which represents the number of submissions assigned to a each reviewer.
Step 3c) Invite a new reviewer
If cannot find a suitable reviewer using the Recommended Reviewers or the Search option, you can invite a new reviewer using the following screen:
Simply enter the reviewer's email address, first name and last name into the box above. Once you click on the "Invite Reviewer" button, the system will send the reviewer an automatic email with links that they can use to setup their account, login and access their newly assigned review.
Step 3d) No Reviewer
You can choose to assign "No Reviewer" for a given review slot. This might be useful towards the end of the conference review process when you can remove non-performing reviewers from the review panel for a given submission. Simply click on their name, choose "No Reviewer" and the system will un-assign the reviewer from the submission.
Step 4) Complete
Depending on what route you take, you will ultimately end up assigning a reviewer to the submission.
The reviewer will have been assigned to the submission.
Step 5) Start the review
Once the assignments are complete, you can now email reviewers to begin reviewing. We have a guide for these steps here.