Pairwise Verbal judgments can be used to evaluate alternatives and/or objectives with respect to another objective or criterion.
Participants enter pairwise comparisons in TeamTime by using either keypads (see Select Participants) or by logging in to the Comparion TeamTime Session using an invitation sent by the Project Manager (see Invite Participants).
Legend:
1) Sentence describing the comparison being made.
Pairwise comparisons are made by the participants by clicking on or between words that express their judgments about the relative importance or preference (see Pairwise Comparisons Contexts) of the two elements shown.
2) Description of one of the two elements being compared.
3) Description of the other element being compared.
4) Description of one of the two elements being compared with respect to the objective or criterion for which this alternative is being compared.
5) Description of the other element being compared with respect to the objective or criterion for which this alternative is being compared.
6) Information document for the parent of the two elements being compared.
You can show the information document or descriptions in a frame or in the tooltip by clicking the information document icon.
7) The pencil icons allow the Project Manager to edit or create information documents for the parent of the two elements being compared, for each of the two elements being compared with respect to information documents, or for information documents for each element being compared as they relate to the parent.
Information documents for each of the elements being compared as well as information documents for each element being compared as they relate to the parent. Information documents can be collapsed or expanded.
8) The legend of the pairwise verbal intensities and their corresponding meaning. The keypad numbers are also shown when the TeamTime keypad is enabled.
9), 10) Names and judgments for participants.
The names are shown formatted as follows:
- Bold – a change made; appears for only a few seconds
- Blue – participant is online.
- Normal (gray) – offline
- Red – no roles for making judgments on the current step
If the participant is only in view-only mode, you can see a (View-only) note right beside the participant.
When there are many participants, the list will be paginated. By default, the "Smart" option is selected which auto-detects the number of participants to display that will best fit the screen and makes the loading faster. You can select users per page by clicking on the links at the right. You can then navigate through the pages using the page numbers at the left.
You can enter comments about judgments you have a role for by clicking
.
Participants can select a word or verbal judgment representing the intensity of their judgment according to AHP's fundamental verbal scale shown in (10) or by choosing an intensity between any of the words, such as between moderately and strongly.
A verbal intensity, such as "strong," may mean different things to different people. As long as people are relatively consistent, it doesn't matter much if one person tends to use more extreme words than another -- they will come up with comparable priorities. However, the word "Equal" should mean the same to everyone. Additionally, the word "Extremely" means an order of magnitude (about 10 to 1) or more and we advise avoiding using Extremely for comparisons where the participant does not feel the elements differ by an order of magnitude or more.
The Project Manager can click on a judgment (or erase with the 
icon) for a participant in cases where the participant needs help.
11) The geometric mean of the judgments is shown, along with the geometric variance.
12) A Navigation Box at the bottom of the screen contains a number for each step in the evaluation sequence.
a. Steps - The number of steps is NOT the same as the number of evaluations because (1) there may be additional pages showing results (2) some pages may have multiple evaluations.
You can click the "?" icon to see what the step colors pertain to:
b. Click the "Current Cluster" 
icon to open the Objectives hierarchy where you can select the parent to jump to the first step "with respect to" the selected node. 
c. Jump to a step by clicking on the ellipses 
, and then entering the step number.
d. Click the steps list 
and select a step. 
e. Click 
to show the participants' evaluation progress.
By default, the Project Manager's evaluation progress is displayed in the navigation box. The Project Manager can select another user to display by selecting the radio button beside the user's name.
The "Next Unassessed" button will also depend on the selected participant.
When a user other than the Project Manager is selected, a person icon will appear, hovering on it will show the user's name/email the evaluation progress data was based on.
13) Checkboxes are provided for an anonymous mode where participant's names are replaced by nominal names, and a mode to Hide Judgments. A typical and recommended process consists of hiding judgments when entering a step, and then showing the judgments for discussion once they have been made. The time since the last judgment is indicated in (19) as discussed below.
14) TeamTime Evaluation option settings:
a) The polling time interval for sending judgments to the server is set to 1 second. This can be increased if desired by clicking on the + sign.
b) Select the sorting of the evaluator's list (by name, email or keypad number. (if any))
c) Option to show the variance when the judgments are hidden
d) Option to show the pairwise side when using Keypads and when the judgments are hidden
e) Option to hide the combined results in the results page
f) Option to hide the participants in "View Only" mode
g) Option to hide the project manager in the list
15) The project manager can pause collecting judgments by clicking on the pause icon 
16) The TeamTime meeting can be ended by clicking on the end meeting button 
17) The project manager can make changes to the project during the TeamTime session, including the objectives, alternatives, information documents, participants' roles, etc. The reload project 
icon can be used to reload the updated project into the TeamTime session. Normally the changes are automatically detected. There will be a prompt that will inform the Project Manager that there will be changes in the evaluation. Clicking OK will reload the page.
18) Current status of communications with server and time since last judgment.
19) Jump to the previous or next step.
