Welcome to the LimeSurvey Community Forum

Ask the community, share ideas, and connect with other LimeSurvey users!

Pairwise Comparisons

  • potrafka
  • potrafka's Avatar Topic Author
  • Offline
  • New Member
  • New Member
More
8 years 7 months ago #123815 by potrafka
Pairwise Comparisons was created by potrafka
After digging through the online materials it's not clear to me if I'm able to set up pairwise comparisons, and even more so, have it generate the comparisons in random order. Has anyone in the community had experience with this type of survey design using LimeSurvey? Thanks, Kris
The topic has been locked.
More
8 years 7 months ago - 8 years 7 months ago #123824 by steve_81
Replied by steve_81 on topic Pairwise Comparisons
Hi,

do you mean the semantic differential? Then there is a solution with the Array-question:
manual.limesurvey.org/Question_type_-_Array

Just seperate the two aspects of the pair in one subquestion with | .

Of course you can activate the random order.

Greets
Stefan
Last edit: 8 years 7 months ago by steve_81.
The topic has been locked.
More
8 years 7 months ago #123833 by jelo
Replied by jelo on topic Pairwise Comparisons

steve_81 wrote: do you mean the semantic differential?

Pairwise comparisons are normally a different kind of beast.
And with random the person seems to mean experimental designs.
en.wikipedia.org/wiki/Pairwise_comparison
en.wikipedia.org/wiki/Potentially_all_pa...ossible_alternatives

Limesurvey won't support or generate experimental designs or generate questions on base of items which have to be compared pairwise.

I would like to see MaxDiff (Best-Worst Scaling) implemented in Limesurvey. But that won't happen.

The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
The topic has been locked.
More
8 years 7 months ago #123834 by steve_81
Replied by steve_81 on topic Pairwise Comparisons
Oh, I see.
Once I dealt with a conjoint analysis, comparing several product combinations, but there wasn't any randomization, only individual text depending on previous ranking answers.
The topic has been locked.
  • potrafka
  • potrafka's Avatar Topic Author
  • Offline
  • New Member
  • New Member
More
8 years 7 months ago #123835 by potrafka
Replied by potrafka on topic Pairwise Comparisons
Thanks for the quick replies, much appreciated. I was unfamiliar with the term semantic differential, so that was good learning for me, but Jelo is correct in terms of the solution I'm looking for here. Hopefully someone will add this feature to the program in the future, would love to use LimeSurvey over one of the bigger for-profit survey companies.
The topic has been locked.
More
8 years 7 months ago #123837 by jelo
Replied by jelo on topic Pairwise Comparisons
Which tool offers the functionality you're looking for? I haven't done pairwise comparison for years.
When such time-consuming tasks are allowed to part of a survey, Best-Worstscaling or a Conjoint flavor is choosen.

The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
The topic has been locked.
More
8 years 7 months ago - 8 years 7 months ago #123838 by jelo
Replied by jelo on topic Pairwise Comparisons

steve_81 wrote: Once I dealt with a conjoint analysis, comparing several product combinations, but there wasn't any randomization

Well, there are a few flavors of Conjoint. Pairwise comparisons are common in traditional Conjoint and adaptive Conjoint (ACA). Both are are no longer used that often.

Randomization and the designplans are different beasts. Let's say controlled randomization.
When showing these pairwise comparison tasks, you want to make sure that:
1.) Every task is asked on different positions in the interview
2.) Every item of the task is not always on right or left position.

With conjoint it is often the case, that you cannot ask every combination at every position to every proband.
The software then allows you to create a individual set of tasks for every proband. Since you don't know how many probands you get, the software created e.g. 300 designs upfront and the 301th proband gets the first design again.
That way you can ensure that not the position of an item was responsible for importance attributed to the item.
This is quite sophisticated stuff, where companies charge 10.000 USD per year or more. But Limesurvey is not R ;-)

A few questions types to get a look like displayed in these demos would be a big step
dcm.atwebpages.com/files/index.html

The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
Last edit: 8 years 7 months ago by jelo.
The topic has been locked.
  • lemonlimebitters
  • lemonlimebitters's Avatar
  • Offline
  • Junior Member
  • Junior Member
More
7 years 10 months ago #136056 by lemonlimebitters
Replied by lemonlimebitters on topic Pairwise Comparisons

lemonlimebitters
The topic has been locked.
More
7 years 10 months ago #136062 by jelo
Replied by jelo on topic Pairwise Comparisons
Much hassle for putting one column on the other side of the items ;-)
The most common used maxdiff tool offers this as one questions design. It was the one that was used when the Best Worst Scaling was introduced. Today I would let the two columns stay on the right and save the time for the workaround.

But I haven't used Limesurvey for MaxDiff since I would miss the design of experiments. This would cost too much time and work in Limesurvey.

The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
The topic has been locked.
  • lemonlimebitters
  • lemonlimebitters's Avatar
  • Offline
  • Junior Member
  • Junior Member
More
7 years 10 months ago #136101 by lemonlimebitters
Replied by lemonlimebitters on topic Pairwise Comparisons
I thought this too - the image is deceiving, but this MaxDiff question type allows for only TWO answers to be selected from entire grid (one for Best and one for Worst case).

I can't seem to find any other better alternative for Best/Worst case since Array exclusion filter doesn't work with single answer options such as Radio or Dropdowns.

lemonlimebitters
The topic has been locked.
More
7 years 10 months ago #136182 by jelo
Replied by jelo on topic Pairwise Comparisons

lemonlimebitters wrote: but this MaxDiff question type allows for only TWO answers to be selected from entire grid (one for Best and one for Worst case).

Not sure what you want to achieve. I don't see any problem with having only TWO answers when doing a MaxDiff ( AKA Best Worst Scaling). A classical pairwise task means to ask few to many single choice questions with two answer-items.

The aim with MaxDiff and pairwise tasks is creating a ranking of items (without a enforced scale).
The main work is to create a good design of experiment (DOE).
MaxDiff allows 5-7 items per question. That allows to capture a bit more information than via pairwise questions.

The meaning of the word "stable" for users
www.limesurvey.org/forum/development/117...ord-stable-for-users
The following user(s) said Thank You: lemonlimebitters
The topic has been locked.
  • lemonlimebitters
  • lemonlimebitters's Avatar
  • Offline
  • Junior Member
  • Junior Member
More
7 years 10 months ago #136185 by lemonlimebitters
Replied by lemonlimebitters on topic Pairwise Comparisons
Thanks for pointing that out Jelo :) Lesson learnt not to to take terminology at face value - so much still to Wiki on :blush:

lemonlimebitters
The topic has been locked.

Lime-years ahead

Online-surveys for every purse and purpose