CITOOLKIT
Paired Comparison Analysis
A Practical Tool for Evaluating Options and Prioritizing Solutions
citoolkit.com
Definition
Paired Comparison Analysis is a technique for evaluating a small range of
options by comparing them against each other.
Paired Comparison Analysis 2
It provides valuable insights to assist in making a well-informed decision.
citoolkit.com
Uses
Useful when you need a structured method to compare and prioritize
options based on specific criteria or attributes.
Paired Comparison Analysis 3
Evaluates the relative importance of the different options when selecting among them.
citoolkit.com
Applications
Used in various fields such as decision-making, project prioritization, and
performance evaluation.
Paired Comparison Analysis 4
To choose the most compelling project or problem to solve
To select the alternative that will be the most effective
To rank items based on their relative importance
To identify the most significant issues or factors contributing
to a problem
citoolkit.com
When to Use?
Paired Comparison Analysis 5
When the alternatives are
completely different
Where there is little
objective data to base our
decision on
When comparing different
subjective options
citoolkit.com
Examples of Use
Selecting the product idea or concept design for a new product before it
goes into production.
Paired Comparison Analysis 6
citoolkit.com
Examples of Use
Deciding which skills, qualifications and experience are essential when
hiring people for a new role.
Paired Comparison Analysis 7
citoolkit.com
The Paired Comparison Matrix
The paired comparison matrix will ensure that each comparison is made
only once to avoid duplicating a comparison.
Paired Comparison Analysis 8
Option A Option B Option C Option D
Option A A vs. B A vs. C A vs. D
Option B B vs. C B vs. D
Option C C vs. D
Option D
The matrix should ensure that it does not allow comparisons of an option with itself.
citoolkit.com
The Paired Comparison Matrix
In addition to comparing each option with every other option, you can include
additional information in the paired comparison matrix including weighting and
aggregating the comparisons to calculate overall scores or rankings for each option.
Paired Comparison Analysis 9
Option A Option B Option C Option D
Option A A vs. B A vs. C A vs. D
Option B B vs. C B vs. D
Option C C vs. D
Option D
Count
Rank
citoolkit.com
The Paired Comparison Matrix
Paired Comparison Analysis 10
Option A Option B Option C Option D
Option A A vs. B A vs. C A vs. D
Option B B vs. C B vs. D
Option C C vs. D
Option D
Count 1 2 0 3
Rank 3 2 4 1
It provides however a basis for
further thoughts and analyses
The highest-ranking alternative is not
necessary the most important
citoolkit.com
Steps for Implementing Paired Comparison Analysis
Paired Comparison Analysis 11
With your team, identify the options to be evaluated against each others
• Identify the evaluation criterion to help you make the decision (for example, the
most important or the easiest to implement).
citoolkit.com
Steps for Implementing Paired Comparison Analysis
Paired Comparison Analysis 12
Place all options in both the left-hand column and the top row of the matrix
• In each blank cell, compare each option in the row with an option in the column,
then type the one better meeting the criteria.
• Provide space to add comments or justifications for the comparisons.
B
A
A
A
B
B
citoolkit.com
Steps for Implementing Paired Comparison Analysis
Paired Comparison Analysis 13
Repeat the process until all possible pairs are evaluated
• Count the number of times each option has been chosen.
• Rank the options according to their counts.
• Consider the options with the highest ranking.
Count
Rank
citoolkit.com
Example – How to Spend Your Coming Summer Holidays
Consider the scenario where you need to decide how to spend your
upcoming summer holidays, and you have four ideas under consideration.
Paired Comparison Analysis 14
A: Write a book B: Take a course C: With family D: Long walks
A: Write a book B C D
B: Take a course C B
C: With family C
D: Long walks
Count 0 2 3 1
Rank 4 2 1 3
citoolkit.com
Example – How to Spend Your Coming Summer Holidays
Paired Comparison Analysis 15
A: Write a book B: Take a course C: With family D: Long walks
A: Write a book B,3 C,1 D,2
B: Take a course C,1 B,1
C: With family C,1
D: Long walks
Count 0 2 3 1
Weight 0 4 3 2
Score 0 8 9 2
Rank 4 2 1 3
You may give a weighted score to each comparison (0 means no difference, and 3
means major difference). Here, the ranking will be based on the final weighted scores.
citoolkit.com
Example – Asking a Team about their Highest Motivators
The following is an example that uses the paired comparison analysis to
identify and rank the top motivators for a team.
Paired Comparison Analysis 16
A B C D E F G H I
A: Appreciation A A A A A A A A
B: Achievement C B B B G B B
C: Work condition C C C G C C
D: Power D D G D I
E: Creativity F G E I
F: Interest G F I
G: Financial benefits G G
H: Relationship I
I: Self development
Count 8 5 6 3 1 2 7 0 4
Rank 1 4 3 6 8 7 2 9 5
The team has selected
‘Appreciation’ to be
their top motivator,
followed by ‘financial
benefits.’
citoolkit.com
Further Information
If it’s a team exercise, the selection of people
should be based on their knowledge of the
subject matter.
Further solutions can be developed by mixing
the positive aspects of a number of solutions.
Paired Comparison Analysis 17
citoolkit.com
Further Information
Paired comparison analysis can be used in
performance reviews or assessments to
compare the performance of individuals based
on various criteria.
It can also be used to evaluate the preferences
of consumers for different products or services.
Paired Comparison Analysis 18
© Copyright Citoolkit.com. All Rights Reserved.
CITOOLKIT
Made with by
The Continuous Improvement Toolkit
www.citoolkit.com

Paired Comparison Analysis: A Practical Tool for Evaluating Options and Prioritizing Solutions

  • 1.
    CITOOLKIT Paired Comparison Analysis APractical Tool for Evaluating Options and Prioritizing Solutions
  • 2.
    citoolkit.com Definition Paired Comparison Analysisis a technique for evaluating a small range of options by comparing them against each other. Paired Comparison Analysis 2 It provides valuable insights to assist in making a well-informed decision.
  • 3.
    citoolkit.com Uses Useful when youneed a structured method to compare and prioritize options based on specific criteria or attributes. Paired Comparison Analysis 3 Evaluates the relative importance of the different options when selecting among them.
  • 4.
    citoolkit.com Applications Used in variousfields such as decision-making, project prioritization, and performance evaluation. Paired Comparison Analysis 4 To choose the most compelling project or problem to solve To select the alternative that will be the most effective To rank items based on their relative importance To identify the most significant issues or factors contributing to a problem
  • 5.
    citoolkit.com When to Use? PairedComparison Analysis 5 When the alternatives are completely different Where there is little objective data to base our decision on When comparing different subjective options
  • 6.
    citoolkit.com Examples of Use Selectingthe product idea or concept design for a new product before it goes into production. Paired Comparison Analysis 6
  • 7.
    citoolkit.com Examples of Use Decidingwhich skills, qualifications and experience are essential when hiring people for a new role. Paired Comparison Analysis 7
  • 8.
    citoolkit.com The Paired ComparisonMatrix The paired comparison matrix will ensure that each comparison is made only once to avoid duplicating a comparison. Paired Comparison Analysis 8 Option A Option B Option C Option D Option A A vs. B A vs. C A vs. D Option B B vs. C B vs. D Option C C vs. D Option D The matrix should ensure that it does not allow comparisons of an option with itself.
  • 9.
    citoolkit.com The Paired ComparisonMatrix In addition to comparing each option with every other option, you can include additional information in the paired comparison matrix including weighting and aggregating the comparisons to calculate overall scores or rankings for each option. Paired Comparison Analysis 9 Option A Option B Option C Option D Option A A vs. B A vs. C A vs. D Option B B vs. C B vs. D Option C C vs. D Option D Count Rank
  • 10.
    citoolkit.com The Paired ComparisonMatrix Paired Comparison Analysis 10 Option A Option B Option C Option D Option A A vs. B A vs. C A vs. D Option B B vs. C B vs. D Option C C vs. D Option D Count 1 2 0 3 Rank 3 2 4 1 It provides however a basis for further thoughts and analyses The highest-ranking alternative is not necessary the most important
  • 11.
    citoolkit.com Steps for ImplementingPaired Comparison Analysis Paired Comparison Analysis 11 With your team, identify the options to be evaluated against each others • Identify the evaluation criterion to help you make the decision (for example, the most important or the easiest to implement).
  • 12.
    citoolkit.com Steps for ImplementingPaired Comparison Analysis Paired Comparison Analysis 12 Place all options in both the left-hand column and the top row of the matrix • In each blank cell, compare each option in the row with an option in the column, then type the one better meeting the criteria. • Provide space to add comments or justifications for the comparisons. B A A A B B
  • 13.
    citoolkit.com Steps for ImplementingPaired Comparison Analysis Paired Comparison Analysis 13 Repeat the process until all possible pairs are evaluated • Count the number of times each option has been chosen. • Rank the options according to their counts. • Consider the options with the highest ranking. Count Rank
  • 14.
    citoolkit.com Example – Howto Spend Your Coming Summer Holidays Consider the scenario where you need to decide how to spend your upcoming summer holidays, and you have four ideas under consideration. Paired Comparison Analysis 14 A: Write a book B: Take a course C: With family D: Long walks A: Write a book B C D B: Take a course C B C: With family C D: Long walks Count 0 2 3 1 Rank 4 2 1 3
  • 15.
    citoolkit.com Example – Howto Spend Your Coming Summer Holidays Paired Comparison Analysis 15 A: Write a book B: Take a course C: With family D: Long walks A: Write a book B,3 C,1 D,2 B: Take a course C,1 B,1 C: With family C,1 D: Long walks Count 0 2 3 1 Weight 0 4 3 2 Score 0 8 9 2 Rank 4 2 1 3 You may give a weighted score to each comparison (0 means no difference, and 3 means major difference). Here, the ranking will be based on the final weighted scores.
  • 16.
    citoolkit.com Example – Askinga Team about their Highest Motivators The following is an example that uses the paired comparison analysis to identify and rank the top motivators for a team. Paired Comparison Analysis 16 A B C D E F G H I A: Appreciation A A A A A A A A B: Achievement C B B B G B B C: Work condition C C C G C C D: Power D D G D I E: Creativity F G E I F: Interest G F I G: Financial benefits G G H: Relationship I I: Self development Count 8 5 6 3 1 2 7 0 4 Rank 1 4 3 6 8 7 2 9 5 The team has selected ‘Appreciation’ to be their top motivator, followed by ‘financial benefits.’
  • 17.
    citoolkit.com Further Information If it’sa team exercise, the selection of people should be based on their knowledge of the subject matter. Further solutions can be developed by mixing the positive aspects of a number of solutions. Paired Comparison Analysis 17
  • 18.
    citoolkit.com Further Information Paired comparisonanalysis can be used in performance reviews or assessments to compare the performance of individuals based on various criteria. It can also be used to evaluate the preferences of consumers for different products or services. Paired Comparison Analysis 18
  • 19.
    © Copyright Citoolkit.com.All Rights Reserved. CITOOLKIT Made with by The Continuous Improvement Toolkit www.citoolkit.com