Pairwise Comparisons

More
3 years 3 months ago #123815 by potrafka
potrafka created the topic: Pairwise Comparisons
After digging through the online materials it's not clear to me if I'm able to set up pairwise comparisons, and even more so, have it generate the comparisons in random order. Has anyone in the community had experience with this type of survey design using LimeSurvey? Thanks, Kris

Please Log in or Create an account to join the conversation.

More
3 years 2 months ago - 3 years 2 months ago #123824 by steve_81
steve_81 replied the topic: Pairwise Comparisons
Hi,

do you mean the semantic differential? Then there is a solution with the Array-question:
manual.limesurvey.org/Question_type_-_Array

Just seperate the two aspects of the pair in one subquestion with | .

Of course you can activate the random order.

Greets
Stefan
Last Edit: 3 years 2 months ago by steve_81.

Please Log in or Create an account to join the conversation.

More
3 years 2 months ago #123833 by jelo
jelo replied the topic: Pairwise Comparisons

steve_81 wrote: do you mean the semantic differential?

Pairwise comparisons are normally a different kind of beast.
And with random the person seems to mean experimental designs.
en.wikipedia.org/wiki/Pairwise_comparison
en.wikipedia.org/wiki/Potentially_all_pa...ossible_alternatives

Limesurvey won't support or generate experimental designs or generate questions on base of items which have to be compared pairwise.

I would like to see MaxDiff (Best-Worst Scaling) implemented in Limesurvey. But that won't happen.

Are you a student conducting a survey? If yes, tell me why you use LimeSurvey?
www.limesurvey.org/forum/development/116...y-you-use-limesurvey

Please Log in or Create an account to join the conversation.

More
3 years 2 months ago #123834 by steve_81
steve_81 replied the topic: Pairwise Comparisons
Oh, I see.
Once I dealt with a conjoint analysis, comparing several product combinations, but there wasn't any randomization, only individual text depending on previous ranking answers.

Please Log in or Create an account to join the conversation.

More
3 years 2 months ago #123835 by potrafka
potrafka replied the topic: Pairwise Comparisons
Thanks for the quick replies, much appreciated. I was unfamiliar with the term semantic differential, so that was good learning for me, but Jelo is correct in terms of the solution I'm looking for here. Hopefully someone will add this feature to the program in the future, would love to use LimeSurvey over one of the bigger for-profit survey companies.

Please Log in or Create an account to join the conversation.

More
3 years 2 months ago #123837 by jelo
jelo replied the topic: Pairwise Comparisons
Which tool offers the functionality you're looking for? I haven't done pairwise comparison for years.
When such time-consuming tasks are allowed to part of a survey, Best-Worstscaling or a Conjoint flavor is choosen.

Are you a student conducting a survey? If yes, tell me why you use LimeSurvey?
www.limesurvey.org/forum/development/116...y-you-use-limesurvey

Please Log in or Create an account to join the conversation.

More
3 years 2 months ago - 3 years 2 months ago #123838 by jelo
jelo replied the topic: Pairwise Comparisons

steve_81 wrote: Once I dealt with a conjoint analysis, comparing several product combinations, but there wasn't any randomization

Well, there are a few flavors of Conjoint. Pairwise comparisons are common in traditional Conjoint and adaptive Conjoint (ACA). Both are are no longer used that often.

Randomization and the designplans are different beasts. Let's say controlled randomization.
When showing these pairwise comparison tasks, you want to make sure that:
1.) Every task is asked on different positions in the interview
2.) Every item of the task is not always on right or left position.

With conjoint it is often the case, that you cannot ask every combination at every position to every proband.
The software then allows you to create a individual set of tasks for every proband. Since you don't know how many probands you get, the software created e.g. 300 designs upfront and the 301th proband gets the first design again.
That way you can ensure that not the position of an item was responsible for importance attributed to the item.
This is quite sophisticated stuff, where companies charge 10.000 USD per year or more. But Limesurvey is not R ;-)

A few questions types to get a look like displayed in these demos would be a big step
dcm.atwebpages.com/files/index.html

Are you a student conducting a survey? If yes, tell me why you use LimeSurvey?
www.limesurvey.org/forum/development/116...y-you-use-limesurvey
Last Edit: 3 years 2 months ago by jelo.

Please Log in or Create an account to join the conversation.

More
2 years 6 months ago #136056 by lemonlimebitters
lemonlimebitters replied the topic: Pairwise Comparisons

lemonlimebitters
Attachments:

Please Log in or Create an account to join the conversation.

More
2 years 6 months ago #136062 by jelo
jelo replied the topic: Pairwise Comparisons
Much hassle for putting one column on the other side of the items ;-)
The most common used maxdiff tool offers this as one questions design. It was the one that was used when the Best Worst Scaling was introduced. Today I would let the two columns stay on the right and save the time for the workaround.

But I haven't used Limesurvey for MaxDiff since I would miss the design of experiments. This would cost too much time and work in Limesurvey.

Are you a student conducting a survey? If yes, tell me why you use LimeSurvey?
www.limesurvey.org/forum/development/116...y-you-use-limesurvey

Please Log in or Create an account to join the conversation.

More
2 years 6 months ago #136101 by lemonlimebitters
lemonlimebitters replied the topic: Pairwise Comparisons
I thought this too - the image is deceiving, but this MaxDiff question type allows for only TWO answers to be selected from entire grid (one for Best and one for Worst case).

I can't seem to find any other better alternative for Best/Worst case since Array exclusion filter doesn't work with single answer options such as Radio or Dropdowns.

lemonlimebitters

Please Log in or Create an account to join the conversation.

More
2 years 6 months ago #136182 by jelo
jelo replied the topic: Pairwise Comparisons

lemonlimebitters wrote: but this MaxDiff question type allows for only TWO answers to be selected from entire grid (one for Best and one for Worst case).

Not sure what you want to achieve. I don't see any problem with having only TWO answers when doing a MaxDiff ( AKA Best Worst Scaling). A classical pairwise task means to ask few to many single choice questions with two answer-items.

The aim with MaxDiff and pairwise tasks is creating a ranking of items (without a enforced scale).
The main work is to create a good design of experiment (DOE).
MaxDiff allows 5-7 items per question. That allows to capture a bit more information than via pairwise questions.

Are you a student conducting a survey? If yes, tell me why you use LimeSurvey?
www.limesurvey.org/forum/development/116...y-you-use-limesurvey
The following user(s) said Thank You: lemonlimebitters

Please Log in or Create an account to join the conversation.

More
2 years 6 months ago #136185 by lemonlimebitters
lemonlimebitters replied the topic: Pairwise Comparisons
Thanks for pointing that out Jelo :) Lesson learnt not to to take terminology at face value - so much still to Wiki on :blush:

lemonlimebitters

Please Log in or Create an account to join the conversation.

Start now!

Just create your account and start using Limesurvey today.

Register now
Join our Newsletter!