Expression Manager

2013-01-31T12:57:48Z

Mdekker:

__TOC__

<div class="simplebox"> Note: This feature is only available in LimeSurvey 1.92 or later. </div>

=Quick Start Tutorial=

==Overview==

When customizing your surveys, you typically need a way to specify the following:
#'''Navigation/Branching''' - letting a subject's answers change the order in which questions are asked
#'''Tailoring/Piping''' - how to phrase the question (such as referring to prior answers, or conjugating sentences based upon the number or gender of your subjects), or how to generate custom reports (like assessment scores or tailored advice).
#'''Validation''' - ensuring that answers pass certain criteria, like min and max values, or matching an input pattern

Expression Manager (EM) provides an intuitive way to specifying the logic for each of those features. Nearly anything that you can write as a standard mathematical equation is a valid expression, even if you are calling functions. EM currently provides access to 70 functions, and can be easily extended to support more. It also lets you access your variables using human-readable variable names (rather than SGQA names).

The following sections show the main places where Expression Manager is used

==Relevance (Controlling Navigation/Branching)==

Some surveys use "Goto Logic", such that if you answer Question 1 with option C, then jump to Question 5. This approach is very limiting, since is hard to validate, and easily breaks if you have to re-order questions. EM uses an Boolean relevance equation to specify all of the conditions under which a question might be valid. If the question is relevant, then the question is asked, otherwise it is Not Applicable, and the value NULL is stored in the database. This is similar to what can be done via the Conditions editor, but EM lets you easily specify much more complex and powerful criteria (and lets you use the variable name rather than SGQA naming).

This image shows one way to review the relevance logic for a survey. It computes Body Mass Index. The relevance equation is shown in square bracket right after the variable name (which is in green). So, the relevance of weight, weight_units, weight_kg are all 1, meaning that those questions are always asked. However, the relevance for BMI is {!is_empty(height) and !is_empty(weight)}, which means that BMI will only be computed if the subject enters a value for both height and weight (thereby avoiding the risk of a divide by zero error). Also, the Report question is only shown if the subject answers all four main questions (height, height_units, weight, weight_units).

[[File:tutorial1.jpg]]

Relevance is shown and editable in the following places:

===Viewing / Editing Question-Level Relevance===

This equation computes the Body Mass Index (BMI). It is only asked if the person first enters their height and weight.

[[File:tutorial2.jpg]]

This is the edit screen for the BMI question.

[[File:tutorial3.jpg]]

Note that you do not use the curly braces when you enter a Relevance Equation.

===Viewing / Editing Group-Level Relevance===

This is a sample census survey. The first page asks how many people live with you and stores that in the "cohabs" variable. This page is only shown if you have more than one cohabitant (so it is shown for the second person cohabitating with you), and also only shows if you specified how Person One is related to you (p1_rel).

[[File:tutorial4.jpg]]

As you can see, the group also has question-level relevance criteria, such that each question only appears once you have answered the question before it (e.g. {!is_empty(p1_sex)}. EM combines the Group and Question-level relevance for you. Questions in a group are only asked if the group as a whole is relevant. Then, only the subset of questions within the group that are relevant are asked.

Here is the screen for editing the group-level relevance for that question:

[[File:tutorial5.jpg]]

Note that you do not use the curly braces when you enter a Relevance Equation.

==Tailoring/Piping==

EM lets you easily do simple and complex conditional tailoring of your questions. Sometimes you just need simple substitution, like saying, "You said you purchased <nowiki>[</nowiki>Product]. What did you like best about it?". Sometimes you need conditional substitution like "<nowiki>[</nowiki>Mr./Mrs.] <nowiki>[</nowiki>LastName], would you be willing to complete our survey?". In this case, you want to use Mr. or Mrs. based upon the person's gender. Other times you need even more complex substitution (such as based upon a mathematical computation. EM supports each of these types of tailoring/piping.

===Conditional Equations===

The Body Mass Index example shows the ability to compute a person's BMI, even while letting them enter their height in weight in metric or non-metric units.

[[File:tailoring7.jpg]]

Here weight_kg is {if(weight_units == 'kg', weight, weight * .453592)}. This if() function means that if the subject entered the weight using kilograms, use that value, otherwise multiple the entered value (which was in pounds) by .453592 to convert it to kilograms. The height_m variable uses a similar approach to compute the person's height in meters, even if he entered his height in inches.

BMI computes the weight formula as {weight_kg / (height_m * height_m)}.

Lastly, the report conditionally tailors the message for the subject, telling him what he entered (e.g. "You said you are 2 meters tall and weight 70 kg."

Although not well shown in the above image, weight_status uses nested if() statements to categorize the person as underweight to severely obese. You can see its equation in the Show Logic View

[[File:tailoring8.jpg]]

From the edit window for this question, you can see two things:
#Tailoring must surround expressions with Curly Braces
#Expressions can span multiple lines if, as in this case, you want to make it easier to read the nested conditional logic.

[[File:tailoring9.jpg]]

===Tailored Questions, Answers, and Reports===

<div class="simplebox">Note: Dynamic tailoring may not work if answer options are made available in select boxes on the same question page. This results from the fact that tailoring inserts a <span> tag which is not valid inside select options.</div>

This example shows the BMI report.

[[File:tailoring10.jpg]]

Here is the edit window for the same question.

[[File:tailoring11.jpg]]

As you can see, anything in curly braces is treated as an expression, so is syntax-highlighted (color coded) in the prior image. If you had any typos (such as misspelled or undefined variable names or functions), EM would show an error, such as this, showing that height_unit is an undefined variable name (it is actually height_units), and rnd() is an undefined function (the proper function name is round()). In both cases, the errors are surrounded by a red box to make it easier to spot and fix them.

[[File:tailoring12.jpg]]

You can also see that you can quickly create complex reports, such as a table of entered values or tailored advice.

Please remember that all tailoring must surround expressions with Curly Braces, so that LimeSurvey knows which parts of the question are free text and which should be parsed through Expression Manager.

==Validation==

EM controls how most of the advanced question options work. These control aspects like min/max numbers of answers; min/max individual values; min/max sum values; and checking that entered values match specified string patterns. You continue to enter those advanced question options as usual. However, now any value in one of those fields is considered an expression, so you can have min/max criteria with complex conditional relationships to other questions.

In all of these cases, since the advanced question option is always considered an expression, you do not use curly braces when specifying it.

The [[Expression Manager Sample Surveys|Sample Surveys]] pages shows many working examples of using expressions for validations.

=Introduction=

LimeSurvey 1.92 and later uses the new Expression Manager (EM) module which will let LimeSurvey support more complex branching, assessments, validation, and tailoring. It will replace how LimeSurvey manages Replacements, Conditions, and Assessments on the back-end. It will also speed up processing considerably since it eliminates most run-time database reads. EM was developed by Dr. Thomas White (TMSWhite).

This wiki page is the definitive reference for Expression Manager syntax and functionality.

==Key Definitions==
#'''Expression''': Anything surrounded by curly braces
**As long as there is no white space immediately after the opening brace or before the closing curly brace
**The contents of Expressions are evaluted by EM, so they can contain mathematical formulas, functions, and complex string and date processing.
#'''Tailoring''': Sometimes called "piping", this is the process of conditionally modifying text
**You have access to all 'replacement fields', TOKENs, and INSERTANS values
**You also have easier access to questions, answers, and their properties.
#'''Relevance''' Equation: A new question attribute controlling question visiblity
**If there is a relevance equation, then the question is only shown if the relevance evaluates to true.
**Internally, all array_filter and array_filter_exclude commands become sub-question-level relevance
#'''Equation''' Question Type: A new question type that saves calculations or reports to the database
**It is like a Boilerplate question, but its contents are saved to the database even if you set "Always Hide this Question"
#'''SGQA''': This is how variables are named in LimeSurvey <= 1.91+
**Stands for Survey-Group-Question-Answer
**SGQA variable names look like 123X5X382X971, and may have sub-question suffixes.
**These variable names are specific to the underlying S/Q/G/A database codes, so often need to be changed
#'''Question Code''': This is the preferred variable name for EM
**This can be a descriptive name indicating the purpose of the question, making it easier to read complex logic
**Although not required to be unique in <= 1.91+, it must be unique if you want to use EM
**Valid question codes should NOT start with a number, so when using the question code to number your questions, simply use "q1", or "q1a" or "g1q2".
**This is what currently becomes the variable name if you export data to SPSS or R, so if you do statistical analysis, you probably already made this unique.

==Do I have to use EM?==

The short answer is No (but also yes).

EM is fully backwards-compatible with existing surveys. So, if you are happy to use Conditions and Assessments in the style that LimeSurvey used in versions <= 1.91+, you can continue to do so.

However, EM completely replaces how LimeSurvey internally deals with Conditions. Although you can still use the Conditions Editor to create and manage conditions, LimeSurvey 1.92 will convert those to the equivalent Relevance Equations. As part of the upgrade, LimeSurvey 1.92 will auto-convert all existing Conditions to Relevance Equations.

This should give you the best of both worlds - you can continue using LimeSurvey as you are used to, but will see the Relevance Equation equivalent so you can gradually migrate to Relevance Equations directly whenever you see fit.

==Can I mix use of Conditions and Relevance?==

Yes. You can use the Conditions editor for some questions and the Relevance editor for others. Conditions are auto-converted to Relevance when you save the question.

Note, we assume that if you are using the Conditions editor, that you want those Conditions to over-write any manually entered Relevance equation. So, if you have existing Conditions and want to manually edit the Relevance, please delete the Conditions for that question first. Specifically, copy the generated relevance equation to a text editor, use the Conditions menu to delete all of the conditions for that question (which will also delete the relevance), then edit the question and paste the generated relevance equation from the text editor back into the relevance field for that question (and save the question). If there is enough demand for deleting conditions without deleting the generated relevance equation, we could add a bulk conversion process.

==How should I choose between Conditions and Relevance?==

Here is a list of pros and cons of each style:

{|
|Style||Pros||Cons
|-
|Conditions||1. Nice GUI for creating simple conditions <br/>2. GUI well documented and understood by support team||1. Only supports simple comparisons and does not AND/OR conditions well <br/>2. Cascading conditions work erratically <br/>3. Slow - database intensive, so can slow down long surveys <br/>4. Some reported problems with re-loading conditions <br/>5. GUI doesn't scale well when there are dozens, hundreds, or thousands of questions <br/>6. May be slow to convert paper-based surveys since must use SGQA names <br/>7. Often need a programmer to custom-code logic needed for complex branching
|-
|Relevance||1. Supports very complex logic, including 80+ functions and math/string operators <br/>2. Perfect support for cascading logic <br/>3. Fast - no extra database calls, so supports 1000+ question surveys <br/>4. No problems with re-loading logic since does not require SGQA codes <br/>5. Syntax-highlighting scales to 1000+ question surveys <br/>6. Easy and fast to use for groups wanting to computerize existing paper-based suveys. <br/>7. Easily supports semi-structured interviews and epidemiological surveys without needing a programmers||1. No GUI for simple conditions - use syntax-highlighting instead <br/>2. New, so support teams have not mastered EM yet.
|-
|
|}

The bottom is that if you are happy with how LimeSurvey 1.91+ works, there is no reason to change what you do.

==What are some other benefits of using EM?==

Here are some of the other reasons you might want to use EM.
#Calculations - you can create any calculation you can think of:
**You have access to all common mathematical operators and functions
**You have access to 70+ mathematical, date, and string processing functions
**It is fairly easy for developers to add new functions if users need them
#Storing Calculations to Database
**You can now compute simple and complex calculations and/or scale scores AND have them stored in the database without needing JavaScript.
**You use the Equation question type to accomplish this.
#Assessments
**You can now create assessments or scale scores from any question type, not just the subset that used to be supported
**You can use Tailoring to show running or total assessment scores anywhere needed - even on the same page
**You have more control over the reports generated based upon those assessment scores
**You can store assessment scores in the database without needing JavaScript
**You can hide assessment scores without needing JavaScript or CSS
#Replacement Fields
**Instead of using {INSERTANS:SGQA}, you can just use the Question Code - this makes it easier to read and validate.
**This also avoids the common need to edit questions to change the SGQA code to make everything work.
#Tailoring - you can conditionally display text based upon other values
**Use the appropriate title for a subject, like (e.g. "Hello <nowiki>[</nowiki>Mr./Mrs.] Smith")
**Output gramatically correct sentences based when singular/plural matter: (e.g. "You have 1 child" vs. "You have 2 chldren")
**Appropriately conjugate verbs and decline nouns based upon subject's gender and plurality.
#New Variable Attributes - you can access the following to do your tailoring:
** (no suffix) - an alias for qcode.code
**.code - the selected response code for the question if it is relevant (otherwise blank), or the text value if it is not a coded question
**.NAOK - same as .code, but can be part of calculations or lists even if irrelevant
**.value - the assessment value for the question if it is relevant (otherwise blank), or the text value if it is not a coded question
**.valueNAOK - same as .value, but can be part of calculations or lists even if irrelevant
**.shown - the answer as displayed to the user (this is what {INSERTANS:xxx} does)
**.qid - the question ID
**.gid - the group ID
**.sgqa - the SGQA value for the question
**.jsName - the correct javascript variable name for the question, regardless whether defined on this page or another
**.qseq - the question sequence (starting from 0)
**.gseq - the group sequence (starting from 0)
**.mandatory - whether the question is mandatory (Y/N)
**.question - the text of the question
**.relevance - the relevance equation for the question
**.grelevance - the relevance equation for the group
**.relevanceStatus - whether or not the question is currently relevant (1 if true, 0 if false)
**.type - the question type (the one character code)
#Dynamic On-Page Changes
**All Relevance, Calculation, and Tailoring works dynamically on a page - so changes in values instantly update the page
**So, you have questions dynamically appear/disappear based upon whether they are relevant
**Questions are also dynamically tailored based upon responses on the page, so you can see running totals, tailored sentences and customized reports.
#New Data Entry Screen
**In addition to using the current data-entry system, you can just use Survey-All-In-One.
**This supports the on-page relevance and tailoring, so data entry clerks can quickly tab through and they will only have to enter the relevant responses
**This can be critical if your data entry person needs to see the tailoring, which is also dynamic.
#Eliminates the need for most custom JavaScript
**EM easily supports complicated computations, scoring, tailoring and conditional logic.
**Some things will still need JavaScript (like custom layouts and conditionally hiding question sub-elements), but your JavaScript can use the EM functions so that you can access questions by their Qcode instead of SGQA, and access any of the question properties listed above.

==What are some other helpful new features enabled by EM?==

Regardless of whether you continue to use the Conditions Editor or manually compose Relevance Equations, you get these additional benefits:
#You can create more complex validation criteria
**All of the advanced question attribute (like max_answers, min_num_value_n, max_num_value) can use Expressions. So, you min/max criteria can be easily adjusted based upon prior responses, even if they are on the same page.
**EM also handles all regular-expression-based validation, so you can robustly combine preg and equation-based question attributes.
#Easy Re-ordering (or deleting) of Questions and Groups
**Prior to version 1.92, you could not re-order questions or groups if LimeSurvey thought that such-re-ordering could break conditions in which they were used. Similarly, you could not delete questions if any other questions depended upon them.
**With EM's syntax highlighting, it is easy to see and validate whether you try to use questions before they are declared. So, we now let you re-order or delete questions and groups whenever you like. EM will update all of the syntax highlighting to show you potential errors.
**The re-order questions view has been enhanced to help with such review. It now shows the question's relevance equation and tailoring, so you can immediately see whether any variables become pink (meaning they are used before being declared).
#The Question/Group Navigation Index is always available and accurate
**Prior to version 1.92, these indexes were not available if there were complex conditions
**With EM, we can guarantee that they are accurate.
**Subjects can even jump back, to a prior question, change the answer, then jump forward (or submit)
***When jumping forwards, EM will re-validate all of the intervening questions/groups.
***If any questions become irrelevant, they will be NULLed in the database so that your data is internally consistent
***If any questions become relevant or newly fail mandatory or validation rules, EM will stop on that page and force the user to answer those questions before jumping to their final destination.
#Auto-conversion of Conditions to Relevance
**When you upgrade your database, all existing surveys that have conditions will have relevance equations generated for them
**Whenever you import a survey, relevance equations will be created as needed
**Whenever you add, delete, or modify conditions, EM will generate the appropriate relevance equation.
#Convenient Syntax Highlighting
**When EM shows the relevance equation, it will show the Qcode, even if you entered an SGQA code, as we assume this will be easier to read.
**All variables are color coded to show whether they were declared before or after the current question (or before or after the current group). This lets you quickly detect and fix cases where you try to use variables for relevance (including array_filter), tailoring, or validation equations prior to declaring them.
**In addition, if you hover your mouse over the color-coded variable, you will see the most important metadata about that question. This includes the Group Sequence #, Question Sequence #, Qcode, Text of the question, and all available answer choices (if it is a question type with enumerated answer choices).
***The list of answer choices uses this syntax: 'answers':{key:val, ... }.
***''key'' has the syntax ''''scale~code'''' where ''scale'' is the answer scale (e.g. for dual scale), and ''code'' is the answer code.
***''val'' has the syntax ''''value~shown'''' where ''value'' is the assessment value (if using assessments, otherwise ''code'')(e.g. Qcode.value), and ''shown'' is the display value as seen by the subject (e.g. Qcode.shown)
***This means that many surveys can use calculations without needing assessment mode. If you have enumerated answer options that are unique, non-decimal, and non-negative, you can simply do calculations on the Qcode.code values).
#Easy review of entire survey logic and content
**There is a new Show Survey Logic feature that lets you see everything about the survey (or group or question) on a single page.
**It shows the Group, Question, Sub-Question, and Answer-level details for the selected scope (survey vs. group vs. question)
**It also shows the relevance, sub-question-level relevance (for array_filter and array_filter_exclude), and generated validation equation (for preg and any validation rules like min/max sum/number of values), and all non-blank question attributes.
**Eveything is syntax-highlighted so that you can see potential syntax errors (like unbalanced parentheses or use of variables before they were declared)
**The syntax-highligting supports rapid navigation and editing of the survey.
***If you click on a variable name, it opens a browser window (or tab) that shows you that question and lets you edit it.
***If you click on a group name, it opens a browser window (or tab) showing the group-reorder view so that you can easily move questions around.
***All of the question attributes are also syntax highlighted. This lets you set and see expressions within advanced question options (like basing the max/min number/sum of values on an expression)
**The EM author used similar view (a little cleaner) to let his collaborating Epidemiologists and Institutional Review Board validate and authorize surveys with thousands of questions in highly branched and tailored structured interviews

==How Backwards Compatible is EM with 1.91+?==

LimeSurvey 1.92 is fully backwards-compatible with 1.91+ with one exception/caveat: 1.92 handles less-than / greater-than comparisons against empty values differently than 1.91+.

One of the LimeSurvey demo surveys uses a set of conditions that translates to this relevance equation: {(age < 16) or (age == 20) or ... or (age == 80)}. In LimeSurvey 1.91+, (age < 16) is FALSE when there is no answer (the value is blank). However, in LimeSurey 1.92, (age < 16) is TRUE when there is no answer, since both PHP and JavaScript treat blank as 0 in mathematical comparisons. Thus, 1.91+ would hide that question when age was unanswered, but 1.92 would show it. We went to great pains to prevent this, but since we needed to have the Expressions generate identical results in PHP and JavaScript, there was no way to make 1.92 treat "" < 16 as FALSE. Fortunately, there is an easy work-around for this. If you want (age < 16) to be FALSE, then use this expression instead: {(!is_empty(age) and age < 16)}. You can use the new [[Show Logic File|Survey Logic File]] view to quickly identify and fix any such comparisons in your survey.

=Getting Started=

The best way to get started with EM is to:
*Install 1.92+ from http://www.limesurvey.org/en/download .
*Import and explore the [[Expression Manager Sample Surveys|sample surveys]].
*Explore the [[Expression Manager HowTos|use cases and HowTos]] and [[Expression Manager Examples|step-by-step examples]].
*Explore the EM documentation (this page)
*Examine the built-in EM test suite
**From any survey, under tools, select the EM option
**Availalbe Functions lists the 70+ functions and syntax
**Unit Tests of Isolsted Expressions
***shows examples of using all EM functions and operators, and the PHP and JavaScript results
***note there are few functions that generate different results in the PHP and JavaScript versions, so this page lets you plan your EM logic accordingly.

=What Functionality does Expression Manager Extend/Replace? (LimeSurvey <= 1.91+)=

==Conditions => Relevance==

Conditions controlled which questions are visible. The general syntax was ''SGQA operator Value'', like ''111X2X3 == "Y"''. Conditions could be ANDed or ORed together, but mixing ANDs and ORs was difficult. The conditions themselves were stored in a separate table, and large portion of LimeSurvey's code was devoted to managing Conditions. Because of extensive database access, processing large numbers of conditions could cause noticable performance problems. Furthermore, once you had conditions assigned to questions or groups, you were often not allowed to re-order or delete them.

==Assessments => Equations and Micro-Tailoring==

Assessments let users create scale scores from a collection of questions. However, they could not dynamically change on the current page, and their values were not stored to the database.

==Replacements => Micro-Tailoring==

Users could tailor some messages and questions based upon prior responses. For example, a question might be, ''{TOKEN:FIRSTNAME}, you said {INSERTANS:111X3X4} was your favorite sport''. However, it was not possible to do conditional tailoring (like say "Mr." or "Mrs." depending upon the person's gender), or conjugate verbs or decline nouns without fancy JavaScript. Authors could implement surveys that seemed to tailor questions, but it required separate questions for each permutation, and complex conditions to decide which questions to display.

==Validation==

Question could be validated with Regular expressions, or minimum/maximum values, or let an SGQA response serve as the minimum or maximum value. However, validations could not be based upon calculations of other variables without fancy JavaScript.

==Equations==

Equations were not supported without fancy JavaScript.

==Equation Question Type==

Equations could not be saved to the database (e.g. the final score for an assessment) without fancy JavaScript.

=How Will Expression Manager Replace/Extend That Functionality?=

The Expression Manager is a new core module within LimeSurvey that makes it much easier to support the type of complex functionality that used to require custom JavaScript. It is also replacing the way LimeSurvey currently manages Conditions and Assessments.

==New Terminology When Referring to Expression Manager (EM)==

EM "thinks" of its functionality in the following terms:
*'''Relevance-based Branching''' - if a question is relevant, then ask it, otherwise don't (e.g. make it invisible, and mark it as NULL in the database). There is a new Relevance field for all Question types, and also for each Group (so you can apply a set of conditions to an entire group without having to copy the same condition to each question, and/or combine group and question-level conditional logic).
*'''Tailoring''' - Once you know which questions should be asked, tailoring (sometimes called ''piping'') specifies how the question should be asked. This lets you support not only simple subsitution (like {TOKEN:FIRSTNAME}), but also conjugation of verbs and declination of nouns based upon the gender or number of your subjects. It also lets you change the message you deliver to a subject based upon whether they answered (or how they answered) other questions.
*'''Equations''' - EM adds a new question type called Equation which stores the result of an Expression. These equations results are computed and written to the database, even if you hide them on the page. Thus, they are useful for hidden scoring calculations, navigation based upon complex equations, assessments, and reports that should be generated and easily available within the database.

===Relevance and Cascading Relevance===

Every question type now has a Relevance option which controls whether the question is displayed. EM processes each of the Relevance Equations in the order they should appear in the survey. If the expression is true (or missing - to support legacy surveys), the question will be diplayed. If it is not relevant, then the question will be hidden, and the value will be NULLed in the database. If there are no relevant questions in a group, the entire group will be skipped.

Moreover, if any of the variables within an expression is irrelevant, then the expression always evaluates to false. This enables Cascading Relevance so that you do not have to write very long Relevance equations for each question.

Say you have 5 questions Q1-Q5, and you only want to show Q2 if Q1 was answered, and Q3 if Q2 was answered, etc. The relevance equations might be:

{|
|Question Code||Relevance||Question
|-
|Q1||1||What is your name?
|-
|Q2||Q1||{Q1}, how old are you?
|-
|Q3||Q2||So, you are {Q2} years old. Are you married?
|-
|Q4||Q3 == "Y"||{Q1}, how long have you been married?
|-
|Q5||Q4||How many children do you have, {Q1}?
|-
|
|}

The relevance calculations also work in JavaScript - so you could put all the above questions on one page and it would still work as expected. In fact, EM totally replaces how EM processes Survey vs. Group vs. Question-at-a-time survey formats. They now all use the exactly same navigation engine so they work identically regardless of survey style.

As long as you are on the same page, any data you entered will still be there, just hidden. So, if you enter some information, then choose and option that makes them irrelevant, then make them relevant again, your answers will still be available. However, as soon as you move to a different page, all irrelevant responses will be lost to integrity of the dataset.

===Group-Level Relevance===

Expression Manager also supports group-level relevance. This makes it easier to implement looping. Say you want to collect information about up to 10 entities (such a products or people in a household), where you first deterimine how many entities need follow-up (such as by asking how many people live in a household, or having people check which products they like from a long list). After knowning how many entities need follow-up, you can use Group-level relevance like {count >= 1}, {count >=2}, ... {count >= 10} for each of the 10 groups of follow-up questions. Within each group, you can have question-level conditional logic (e.g. gender or age-specific follow-up questions for each subject). The question and group-level relevance equations are ANDed together to determine which should be shown.

===Tailoring / Piping===

Anything within curly braces is now treated as an Expression (with one exception described below). Expressions have acccess to all of the LimeReplacementFields, all of the variables (via several aliases), all typical equation operators (mathematical, logical, and comparison), and dozens of functions (that even work dynamically on the client-side).

Using these equations, you can do things such as:
#Conditionally show tailored messages to the respondants based upon prior responses
#Create Assessments and show Assessment results (or conditionally branch or show messages) based upon those results, all without using the Assessments module itself
#Conjugate verbs and decline nouns within questions, answers, and reports.
#Show summaries of responses before the "Show your answers" page at the end of the survey

===Equations===

There is a new question type called Equation. It is like a Boilerplate questions, except that it stores the value of what is displayed in the database. So, if the Equation Question text contains an Assessment computation, that value would be stored in the database in a variable that can be displayed within public or private statistics.

This solves a common request for storing Assessment scores within the database

==Syntax==

Anything contained within curly braces is now considered an Expression (with one exception: there must be no leading or trailing whitespace - this is needed to ensure the Expression Manager does not try to process embedded JavaScript).

Note, it is OK for expressions to span multiple lines, as long as there is no whitespace after the opening curly brace or before the closing curly brace. This is especially helpful for nested if() statements like this:

<syntaxhighlight lang="java" enclose="div">{if(is_empty(PFTotals),

'',

if(PFTotals >= -5 && PFTotals <= -4,

'Very Soft',

if(PFTotals >= -3 && PFTotals <= -2,

'Soft',

if(PFTotals == -1,

'Somewhat Soft',

if(PFTotals == 0,

'Moderate',

if(PFTotals == 1,

'Somewhat Hard',

if(PFTotals >= 2 && PFTotals <= 3,

'Hard',

if(PFTotals >= 4 && PFTotals <= 5,

'Very Hard',

''

)

)

)

)

)

)

)

)}

</syntaxhighlight>

Expression Manager supports the following syntax:
*All standard mathematical operators (e.g. +,-,*,/,!)
*All standard comparison operators (e.g. <,<=,==,!=,>,>=, plus these equivalents: lt,le,eq,ne,gt,ge)
*Parentheses (so you can group sub-expressions)
*Conditional operators (e.g. &&,| | and these equivalents: and,or)
*Single and double-quoted strings (which can each embed strings with the other quote type)
*Comma operator (so can have a list of expressions and just return the final result)
*Assignment operator (=)
*Pre-defined variables (to refer to questions, question attributes, and responses) - e.g. all of the SGQA codes
*Pre-defined functions (there are already 70+, and it is easy to add more)

EM syntax follows normal operator precedence:

{|
|Level||Operator(s)||Description
|-
|1||()||parentheses for grouping or calling functions
|-
|2||! - +||unary operators: not, negation, unary-plus
|-
|3||* /||times, divide
|-
|4||+ -||plus, minus
|-
|5||< <= > >= lt le gt ge||relative comparisons
|-
|6||== != eq ne||equality comparisons
|-
|7||and||logical AND
|-
|8||or||logical OR
|-
|9||=||assignment operator
|-
|10||,||comma operator
|-
|
|}

Note, for consistency between JavaScript and PHP, the plus operator (+) does addition if both operands are numeric, but does concatenation if both parts are non-numeric strings. However, we recommend using the join() function for concatenation, as that makes your intent more clear, and avoids unexpected results if you were expecting strings but got numbers instead (or vice versa).

===Caution about using Assignment Operator (=)===

Note, you should avoid using the assignment operators unless absolutely necessary, since they may cause unexpected side-effects. For example, if you change the value of a previous response, the cascading relevance and validation logic between that question and the current question is not re-computed, so you could end up with internally inconsistent data (e.g. questions that stay answered but should have been NULLed, or questions that are skipped but should have been answered). In general, if you want to assign a value to a variable, you sould create an Equation question type, and use an expression to set its value. However, there are some rare times that people really need this operator, so we made it available.

To help caution you about this operator, it is shown in red font within the syntax equations (so that you don't confuse it with "==")

The main reasons you may want to use assignment are:
*You need to set the default value for a question that does not accept defaults via equation (such as list radio, where the user interface lets you pick one of the answer options, but does not let you enter an equation). However, be careful, as LimeSurvey will not be able to validate that your equation generates one of the allowable answers for that question.
*You need to forcibly change the response to a previous question based upon a later response

==Access to Variables==

Expression Manager provides read-only access to whichever variables we might need. For backwards compatibility, it provides access to the following:
*TOKEN:xxx - the value of a TOKEN (e.g. TOKEN:FIRSTNAME, TOKEN:ATTRIBUTE_5)
*INSERTANS:SGQA - the display value of an answer (e.g. "Yes")
*All {XXX} values used by templates

In addition, Expression Manager lets you refer to variables by the Question Code (the 'title' column in the questions table within the database). This is also the variable label used when you export your data to SPSS, R, or SAS. For example, if you have questions about name, age, and gender, you could call those variables ''name'', ''age'', and ''gender'' instead of ''12345X13X22'', ''12345X13X23'', and ''12345X13X24''. This makes equations easier for everyone to read and validate the logic, plus makes it possible to shuffle questions around without having to keep track of group or question numbers.

Furthermore, Expression Manager lets you access many properties of the Question:

{|
|Syntax||Meaning||Example||Example Result
|-
|Qcode||an alias for Qcode.code||{join(',',name,gender)}||'Tom','M'
|-
|Qcode.code||the selected response code for the question if it is relevant (otherwise blank), or the text value if it is not a coded question||{join(',',name.code,gender.code)}||'Tom','M'
|-
|Qcode.NAOK||same as Qcode - see discussion of NAOK||{gender.NAOK}||'M'
|-
|Qcode.value||the assessment value for the question if it is relevant (otherwise blank), or the text value if it is not a coded question||{gender.value}||'1'
|-
|Qcode.valueNAOK||same as Qcode.value - see discussion about NAOK||{gender.valueNAOK}||'1'
|-
|Qcode.shown||the dispay value for the question||{join(',',name.shown,gender.shown)}||'Tom','Male'
|-
|Qcode.question||the text of the question||{gender.question}||'What is your gender?'
|-
|Qcode.mandatory||whether the question is mandatory (Y/N)||{gender.mandatory}||'N'
|-
|Qcode.qid||the internal question number (not the sequential number)||{gender.qid}||337
|-
|Qcode.type||the question type||{gender.type}||'G'
|-
|Qcode.jsName||the correct javascript name for the question, regardless whether declared on or off this page||{gender.jsName}||'java1827X3X337'
|-
|Qcode.gid||the internal group number (not the sequential number)||{gender.gid}||3
|-
|Qcode.qseq||the sequential number of the question, starting from 0||{gender.qseq}||5
|-
|Qcode.gseq||the sequential number of the group, starting from 0||{gender.gseq}||1
|-
|Qcode.relevanceStatus||whether the question is currently relevant (0 or 1)||{gender.relevanceStatus)||1
|-
|Qcode.relevance||the question-level relevance equation||{gender.relevance}||'!is_empty(name)'
|-
|Qcode.grelevance||the group-level relevance equation||{gender.grelevance}||'num_children >= 5'
|-
|Qcode.sgqa||the SGQA value for this question||{gender.sgqa}||'1827X3X337'
|-
|
|}

=== Security issue===

For security issue, text entered by user are filtered. Some caracter are replaced by HTML entities.
* & by &
* < by <
* > by >

==Qcode Variable Naming==

Here are the details of how to construct a Qcode (and access some properties) by question type. In general, Qcodes are constructed as:

QuestionCode . '_' . AnswerID . '_' . ScaleId

{|
|Type||Description||Code||SubQs||Answer Options||Scales||Answer Code||Answer Shown||Relevance
|-
|5||5 Point Choice Radio-Buttons||Q1|| ||1-5|| ||{Q1}||{Q1.shown}||{Q1==3}
|-
|B||Array (10 Point Choice) Radio-Buttons||Q2||L1-L6||1-10|| ||{Q2_L2}||{Q2_L2.shown}||{Q2_L2==7}
|-
|A||Array (5 Point Choice) Radio-Buttons||Q3||1-5||1-5|| ||{Q3_1}||{Q3_1.shown}||{Q3_1>=3}
|-
|1||Array (Flexible Labels) Dual Scale||Q4||sq1-sq5||0:a1-a3||1:b1-b3||{Q4_sq1_0}||{Q4_sq1_1.shown}||{Q4_sq1_1=='b2'}
|-
|H||Array (Flexible) - Column Format||Q5||1-5||s,m,t|| ||{Q5_1}||{Q5_1.shown}||{Q5_1=='s'}
|-
|F||Array (Flexible) - Row Format||Q6||F1-F5||1-5|| ||{Q6_F3}||{Q6_F3.shown}||{Q6_F3==4}
|-
|E||Array (Increase/Same/Decrease) Radio-Buttons||Q7||1-7||I,S,D|| ||{Q7_4}||{Q7_4.shown}||{Q7_4=='D'}
|-
|:||Array (Multi Flexi) 1 To 10||Q8||ls1,todo,ls2||min,max,avg|| ||{Q8_ls1_max}||{Q8_ls2_avg.shown}||{Q8_ls2_min==7}
|-
|;||Array (Multi Flexi) Text||Q9||hp,st,sw||1st,2nd,3rd|| ||{Q9_hp_3rd}||{Q9_hp_3rd.shown}||{Q9_hp_3rd=='Peter'}
|-
|C||Array (Yes/Uncertain/No) Radio-Buttons||Q10||1-5||Y,N,U|| ||{Q10_1}||{Q10_1.shown}||{Q10_3=='Y'}
|-
|X||Boilerplate Question||Q11|| || || || ||{Q11.shown}||
|-
|D||Date||Q12|| || || ||{Q12}||{Q12.shown}||
|-
|*||Equation||Q13|| || || ||{Q13}||{Q13.shown}||{Q13>5}
|-
|~124~||File Upload (records number of files uploaded)||Q14|| || || ||{Q14}|| ||{Q14>0}
|-
|G||Gender Drop-Down List||Q15|| ||M,F|| ||{Q15}||{Q15.shown}||{Q15=='M'}
|-
|U||Huge Free Text||Q16|| || || ||{Q16}||{Q16.shown}||{strlen(Q16)>100}
|-
|I||Language Question||Q17|| || || ||{Q17}||{Q17.shown}||{Q17=='en'}
|-
|!||List - Dropdown||Q18|| ||1-5|| ||{Q18}||{Q18.shown}||{Q18==3}
|-
|L||List Drop-Down/Radio-Button List||Q19|| ||A-Z|| ||{Q19}||{Q19.shown}||{Q19=='X'}
|-
|O||List With Comment Drop-Down/Radio-Button List + Textarea||Q20|| ||A-F|| ||{Q20},{Q20_comment}||{Q20.shown}||{Q20=='B'}
|-
|T||Long Free Text||Q21|| || || ||{Q21}||{Q21.shown}||{strstr(Q21,'hello')>0}
|-
|M||Multiple Choice Checkbox||Q22||A-F|| || ||{Q22_E}||{Q22_E.shown}||{Q22_E=='Y'}
|-
|P||Multiple Choice With Comments Checkbox + Text||Q23||A-F|| || ||{Q23_D}, {Q23_D_comment}||{Q23_D.shown}||{!is_empty(Q23)}
|-
|K||Multiple Numerical Question||Q24||self,mom,dad|| || ||{Q24_self}||{Q24_self.shown}||{Q24_self>30}
|-
|Q||Multiple Short Text||Q25||A-F|| || ||{Q25_B}||{Q25_B.shown}||{substr(Q25_B,1,1)=='Q')}
|-
|N||Numerical Question Type||Q26|| || || ||{Q26}||{Q26.shown}||{Q26 > 30}
|-
|R||Ranking Style||Q27||1-4|| || ||{Q27_1}||{Q27_1.shown}||{Q27_1==3}
|-
|S||Short Free Text||Q28|| || || ||{Q28}||{Q28.shown}||{Q28=='mine'}
|-
|Y||Yes/No Radio-Buttons||Q29|| || || ||{Q29}||{Q29.shown}||{Q29=='Y'}
|-
|
|}

==The reserved 'this', 'self', and 'that' variables==

Quite often, you want to evalute all parts of a question, such as counting how many sub-questions have been answered, or summing the scores. Other times, you want to process just certain rows or columns of a question (such as getting the row or column sums and storing them in the database). These reserved variables make that process relatively painless.

The 'this' variable is used exclusively within the "Whole question validation equation" and "Sub-question validation equation" advanced question options. It expands to the variable names of each of the cells within those questions. So, if you want to make sure that each entry is greater than three, you would set the "Sub-question validation equation" to (this > 3).

The 'self' and 'that' variable are more powerful, and serve as macros which are expanded prior to processing equations. The syntax choices are:
*self
*self.''suffix''
*self.''sub-selector''
*self.''sub-selector''.''suffix''

''suffix'' is any of the normal qcode suffixes (e.g. NAOK, value, shown)

''sub-selector'' is one of:
*comments - only subquestions that are comments (e.g. from multiple choice with comment and list with comment)
*nocomments - only subquestions that are not comments
*sq_X - where X is a row or column identifier. Only sub-questions matching pattern X are selected.

Examples:
*Has any part of a question been answered? {count(self.NAOK)>0}
*What is the assessment score for this question? {sum(self.value)}

You can also use these to get row and column totals. Say you have a array of numbers with rows A-E and columns 1-5.
*What is the grand total? {sum(self.NAOK)}
*What is the total of row B? {sum(self.sq_B.NAOK)}
*What is the total of column 3? {sum(self.sq_3.NAOK)}

The 'that' variable is like the 'self' variable, but lets you refer to other questions. Its syntax is:
*that.''qname''
*that.''qname''.''suffix''
*that.''qname''.''sub-selector''
*that.''qname''.''sub-selector''.''suffix''

''qname'' is the question name without any sub-question extensions. So, say you create a question 'q1', that is its ''qname''

Examples:
*Has any part of question q1 been answered? {count(that.q1.NAOK)>0}
*What is the assessment score for q2? (sum(that.q2.NAOK)}
*What is the grand total of q3? {sum(that.q3.NAOK)}
*What is the total of row C in q4? {sum(that.q4.sq_C.NAOK)}
*What is the total of column 2 in q4? {sum(that.q4.sq_2.NAOK)}

The 'self' and 'that' variables can be used in any relevance, validation, or tailoring.

The one caveat is that when you use the [[Show Logic File|Show Logic File]] feature, it will show you the expanded value of 'self' and 'that'. This lets you see the actual equation that will be generated so that you (and Expression Manager) can validate that the variables exist. This may seem confusing since you may see quite lenghty equations. However, if you edit the question, you will see the original equation using 'self' and/or 'that'

Also note that you should not use these variables if (a) you want to explicitly name each variable used in an equation, or (b) use variables that do not have sub-questions (e.g. single response questions). In those cases, prefixing a variable with 'that' is overkill, and you run the risk of getting unexpected results.

==Access to Functions==

Expression Manager provides access to mathematical, string, and user-defined functions, as shown below. It has PHP and JavaScript equivalents for these functions so that they work identically on server-side (PHP) and client-side (JavaScript). It is easy to add new functions.

===Implemented Functions===

The following functions are currently available:

{|
|Function||Meaning||Syntax
|-
[http://www.php.net/manual/en/function.abs.php ||abs]||Absolute value||number abs(number)
|-
[http://www.php.net/manual/en/function.acos.php ||acos]||Arc cosine||number acos(number)
|-
[http://www.php.net/manual/en/function.addslashes.php ||addslashes]||Quote string with slashes||string addslashes(string)
|-
[http://www.php.net/manual/en/function.asin.php ||asin]||Arc sine||number asin(number)
|-
[http://www.php.net/manual/en/function.atan.php ||atan]||Arc tangent||number atan(number)
|-
[http://www.php.net/manual/en/function.atan2.php ||atan2]||Arc tangent of two variables||number atan2(number, number)
|-
[http://www.php.net/manual/en/function.ceil.php ||ceil]||Round fractions up||number ceil(number)
|-
[http://www.php.net/manual/en/function.checkdate.php ||checkdate]||Returns true(1) if it is a valid date in gregorian calendar||bool checkdate(month,day,year)
|-
[http://www.php.net/manual/en/function.cos.php ||cos]||Cosine||number cos(number)
|-
|count||count the number of answered (non-blank)questions in the list||number count(arg1, arg12, ..., argN)
|-
|countif||Count the number of answered questions in the list equal the first argument||number countif(matches, arg1, arg2, ... argN)
|-
|countifop||Count the number of answered questions in the list which pass the criteria (arg op value)||number countifop(op, value, arg1, arg2, ... argN)
|-
[http://www.php.net/manual/en/function.date.php ||date]||Format a local date/time||string date(format <nowiki>[</nowiki>, timestamp=time()])
|-
[http://www.php.net/manual/en/function.exp.php ||exp]||Calculates the exponent of e||number exp(number)
|-
|fixnum||Display numbers with comma as radix separator, if needed||string fixnum(number)
|-
[http://www.php.net/manual/en/function.floor.php ||floor]||Round fractions down||number floor(number)
|-
[http://www.php.net/manual/en/function.gmdate.php ||gmdate]||Format a GMT date/time||string gmdate(format <nowiki>[</nowiki>, timestamp=time()])
|-
[http://www.php.net/manual/en/function.html-entity-decode.php ||html_entity_decode]||Convert all HTML entities to their applicable characters (always uses ENT_QUOTES and UTF-8)||string html_entity_decode(string)
|-
[http://www.php.net/manual/en/function.htmlentities.php ||htmlentities]||Convert all applicable characters to HTML entities (always uses ENT_QUOTES and UTF-8)||string htmlentities(string)
|-
[http://www.php.net/manual/en/function.htmlspecialchars.php ||expr_mgr_htmlspecialchars]||Convert special characters to HTML entities (always uses ENT_QUOTES and UTF-8)||string htmlspecialchars(string)
|-
[http://www.php.net/manual/en/function.htmlspecialchars-decode.php ||expr_mgr_htmlspecialchars_decode]||Convert special HTML entities back to characters (always uses ENT_QUOTES and UTF-8)||string htmlspecialchars_decode(string)
|-
[http://www.php.net/manual/en/function.idate.php ||idate]||Format a local time/date as integer||string idate(string <nowiki>[</nowiki>, timestamp=time()])
|-
|if||Excel-style if(test,result_if_true,result_if_false)||if(test,result_if_true,result_if_false)
|-
[http://www.php.net/manual/en/function.implode.php ||implode]||Join array elements with a string||string implode(glue,arg1,arg2,...,argN)
|-
[http://www.php.net/manual/en/function.intval.php ||intval]||Get the integer value of a variable||int intval(number <nowiki>[</nowiki>, base=10])
|-
[http://www.php.net/manual/en/function.empty.php ||is_empty]||Determine whether a variable is considered to be empty||bool is_empty(var)
|-
[http://www.php.net/manual/en/function.is-float.php ||is_float]||Finds whether the type of a variable is float||bool is_float(var)
|-
[http://www.php.net/manual/en/function.is-int.php ||is_int]||Find whether the type of a variable is integer||bool is_int(var)
|-
[http://www.php.net/manual/en/function.is-nan.php ||is_nan]||Finds whether a value is not a number||bool is_nan(var)
|-
[http://www.php.net/manual/en/function.is-null.php ||is_null]||Finds whether a variable is NULL||bool is_null(var)
|-
[http://www.php.net/manual/en/function.is-numeric.php ||is_numeric]||Finds whether a variable is a number or a numeric string||bool is_numeric(var)
|-
[http://www.php.net/manual/en/function.is-string.php ||is_string]||Find whether the type of a variable is string||bool is_string(var)
|-
|list||Return comma-separated list of non-blank values||string list(arg1, arg2, ... argN)
|-
[http://www.php.net/manual/en/function.log.php ||log]||Natural logarithm||number log(number)
|-
[http://www.php.net/manual/en/function.ltrim.php ||ltrim]||Strip whitespace (or other characters) from the beginning of a string||string ltrim(string <nowiki>[</nowiki>, charlist])
|-
[http://www.php.net/manual/en/function.max.php ||max]||Find highest value||number max(arg1, arg2, ... argN)
|-
[http://www.php.net/manual/en/function.min.php ||min]||Find lowest value||number min(arg1, arg2, ... argN)
|-
[http://www.php.net/manual/en/function.mktime.php ||mktime]||Get UNIX timestamp for a date (each of the 6 arguments are optional)||number mktime([hour [, minute [, second [, month [, day [, year ]]]]]])
|-
|modulo-function||The modulo function is '''not supported''' yet. You can use the floor() function instead||floor(x/y)==(x/y)
|-
[http://www.php.net/manual/en/function.nl2br.php ||nl2br]||Inserts HTML line breaks before all newlines in a string||string nl2br(string)
|-
[http://www.php.net/manual/en/function.number-format.php ||number_format]||Format a number with grouped thousands||string number_format(number)
|-
|pi||Get value of pi||number pi()
|-
[http://www.php.net/manual/en/function.pow.php ||pow]||Exponential expression||number pow(base, exp)
|-
[http://www.php.net/manual/en/function.quoted-printable-decode.php ||quoted_printable_decode]||Convert a quoted-printable string to an 8 bit string||string quoted_printable_decode(string)
|-
[http://www.php.net/manual/en/function.quoted-printable-encode.php ||quoted_printable_encode]||Convert a 8 bit string to a quoted-printable string||string quoted_printable_encode(string)
|-
[http://www.php.net/manual/en/function.quotemeta.php ||quotemeta]||Quote meta characters||string quotemeta(string)
|-
[http://www.php.net/manual/en/function.rand.php ||rand]||Generate a random integer, see [[Expression Manager Sample Surveys||#Randomly Ask One Question Per Group||this example]]||int rand() OR int rand(min, max)
|-
|regexMatch||compare a string to a [[Using regular expressions||regular expression]]||bool regexMatch(pattern,input)
|-
[http://www.php.net/manual/en/function.round.php ||round]||Rounds a number to an optional precision||number round(val <nowiki>[</nowiki>, precision])
|-
[http://www.php.net/manual/en/function.rtrim.php ||rtrim]||Strip whitespace (or other characters) from the end of a string||string rtrim(string <nowiki>[</nowiki>, charlist])
|-
[http://www.php.net/manual/en/function.sin.php ||sin]||Sine||number sin(arg)
|-
[http://www.php.net/manual/en/function.sprintf.php ||sprintf]||Return a formatted string||string sprintf(format, arg1, arg2, ... argN)
|-
[http://www.php.net/manual/en/function.sqrt.php ||sqrt]||Square root||number sqrt(arg)
|-
|stddev||Calculate the Sample Standard Deviation for the list of numbers||number stddev(arg1, arg2, ... argN)
|-
[http://www.php.net/manual/en/function.str-pad.php ||str_pad]||Pad a string to a certain length with another string||string str_pad(input, pad_length <nowiki>[</nowiki>, pad_string])
|-
[http://www.php.net/manual/en/function.str-repeat.php ||str_repeat]||Repeat a string||string str_repeat(input, multiplier)
|-
[http://www.php.net/manual/en/function.str-replace.php ||str_replace]||Replace all occurrences of the search string with the replacement string||string str_replace(search, replace, subject)
|-
[http://www.php.net/manual/en/function.strcasecmp.php ||strcasecmp]||Binary safe case-insensitive string comparison||int strcasecmp(str1, str2)
|-
[http://www.php.net/manual/en/function.strcmp.php ||strcmp]||Binary safe string comparison||int strcmp(str1, str2)
|-
[http://www.php.net/manual/en/function.strip-tags.php ||strip_tags]||Strip HTML and PHP tags from a string||string strip_tags(str, allowable_tags)
|-
[http://www.php.net/manual/en/function.stripos.php ||stripos]||Find position of first occurrence of a case-insensitive string||int stripos(haystack, needle <nowiki>[</nowiki>, offset=0])
|-
[http://www.php.net/manual/en/function.stripslashes.php ||stripslashes]||Un-quotes a quoted string||string stripslashes(string)
|-
[http://www.php.net/manual/en/function.stristr.php ||stristr]||Case-insensitive strstr||string stristr(haystack, needle <nowiki>[</nowiki>, before_needle=false])
|-
[http://www.php.net/manual/en/function.strlen.php ||strlen]||Get string length||int strlen(string)
|-
[http://www.php.net/manual/en/function.strpos.php ||strpos]||Find position of first occurrence of a string||int strpos(haystack, needle <nowiki>[</nowiki> offset=0])
|-
[http://www.php.net/manual/en/function.strrev.php ||strrev]||Reverse a string||string strrev(string)
|-
[http://www.php.net/manual/en/function.strstr.php ||strstr]||Find first occurrence of a string||string strstr(haystack, needle)
|-
[http://www.php.net/manual/en/function.strtolower.php ||strtolower]||Make a string lowercase||string strtolower(string)
|-
[http://www.php.net/manual/en/function.strtoupper.php ||strtoupper]||Make a string uppercase||string strtoupper(string)
|-
[http://www.php.net/manual/en/function.substr.php ||substr]||Return part of a string||string substr(string, start <nowiki>[</nowiki>, length])
|-
|sum||Calculate the sum of values in an array||number sum(arg1, arg2, ... argN)
|-
|sumifop||Sum the values of answered questions in the list which pass the criteria (arg op value)||number sumifop(op, value, arg1, arg2, ... argN)
|-
[http://www.php.net/manual/en/function.tan.php ||tan]||Tangent||number tan(arg)
|-
[http://www.php.net/manual/en/function.time.php ||time]||Return current UNIX timestamp||number time()
|-
[http://www.php.net/manual/en/function.trim.php ||trim]||Strip whitespace (or other characters) from the beginning and end of a string||string trim(string <nowiki>[</nowiki>, charlist])
|-
[http://www.php.net/manual/en/function.ucwords.php ||ucwords]||Uppercase the first character of each word in a string||string ucwords(string)
|-
|unique||Returns true if all non-empty responses are unique||boolean unique(arg1, ..., argN)
|-
|
|}

===Functions that are Planned or Being Considered===

Other functions that are planned (or being considered) but which are not implemented yet include the following. Some of these are for backwards compatability with another survey tool.

{|
|Syntax||Meaning||Comments
|-
|e()||returns the value of e||
|-
|formatDate(X,PAT)||return the string value of date X formatted according to Java data format pattern PAT||
|-
|formatNumber(X,PAT)||return the string value of number X formatted according to Java number format pattern PAT||
|-
|getAnsOption(X)||returns the text corresponding to the selected option for answer X||this is the same as X.shown
|-
|getAnsOption(X,Y)||returns the text corresponding to the option at index Y of node X||
|-
|getRelevance(X)||returns the relevance equation for question X||
|-
|getStartTime()||returns the date corresponding to the system time when the interview was started||
|-
|getType(X)||returns the string name of the datatype - e.g. *NA* if isNA()||
|-
|gotoFirst()||jumps to the first relevant set of questions - this violates the normal flow of the system||
|-
|gotoNext()||jumps to the next set of relevant questions - this violates the normal flow of the system||
|-
|gotoPrevious()||jumps to the previous set of relevant questions - this violates the normal flow of the system||
|-
|isAsked(X)||returns true if the answer is neither *NA*, *INVALID*, nor *UNASKED*||
|-
|isInvalid(X)||returns true if the answer is of type *INVALID*||
|-
|isNA(X)||returns true if the answer is of type *NA*||
|-
|isNotUnderstood(X)||returns true if the answer if of type *HUH*||
|-
|isRefused(X)||returns true if the answer is of type *REFUSED*||
|-
|isSpecial(X)||returns true if the answer is of type *UNASKED*, *NA*, *REFUSED*, *INVALID*, *UNKNOWN*, or *HUH*||
|-
|isUnknown(X)||returns true if the answer is of type *UNKNOWN*||
|-
|jumpTo(X)||jump to the group containing the named question -- this violates the normal flow of the system||
|-
|jumpToFirstUnasked()||jump to the first unasked question <strike> thus bypassing previous answered questions </strike> this violates the normal flow of the system||
|-
|lastIndexOf(X,Y)||returns the last index (base 0) of string Y in string X. Returns -1 if Y is not contained within X||
|-
|list(X,...)||a string containing a comma separated list of the positive values with "and" separating the last two||
|-
|mean(X,...)||returns the mean of a list of values||
|-
|numAnsOptions(X)||returns the number of answer options that question X has||
|-
|orlist(X,...)||a string containing a comma separated list of the positive values, with "or" separting the last two||
|-
|parseDate(X,PAT)||returns the date value of string X parsed with Java date format pattern PAT||
|-
|parseNumber(X,PAT)||returns the numerical value of string X parsed with Java number format pattern PAT||
|-
|showAllResponsesExcept(questionList,attributeList,attributeTitleList)||questionList = pipe-delimited list of question identifiers; attributeList = pipe-delimited list of attributes (like question#, title, text, type - so you can decide what to show); attributeTitleList = pipe-delimited list of table headers, so can internationalize the report.||
|-
|showTheseResponses(questionList,attributeList,attributeTitleList)||questionList = pipe-delimited list of question identifiers; attributeList = pipe-delimited list of attributes (like question#, title, text, type - so you can decide what to show); attributeTitleList = pipe-delimited list of table headers, so can internationalize the report.||
|-
|
|}

==Expression Manager Knows Which Variables are Local==

In order to properly build the JavaScript for page, Expression Manager needs to know which variables are set on the page, and what their JavaScript ID is (e.g. for document.getElementById(x)). It also must know which variables are set on other pages (so that it can ensure that the needed <input type='hidden' value='x'> fields are present and populated).

==Cascading Conditions==

If any of the variables are irrelevant, the whole equation will be irrelevant (false). For example, in the following table, N/A means that one of the variables was not relevant

{|
|Operator||Example||a||b||Result
|-
|+ (unary)||+a||N/A|| ||false
|-
|- (unary)||-a||N/A|| ||false
|-
|!||!a||N/A|| ||false
|-
|== (or eq)||a == b||N/A||5||false
|-
|== (or eq)||a == b||N/A||0||false
|-
|== (or eq)||a == b||N/A||N/A||false
|-
|!= (or ne)||a != b||N/A||5|| false
|-
|!= (or ne)||a != b||N/A||N/A|| false
|-
|!= (or ne)||a != b||N/A||0||false
|-
|> (or gt)||a > b||N/A||5|| false
|-
|>= (or ge)||a >= b||N/A||5||false
|-
|< (or lt)||a < b||N/A||5||false
|-
|<= (or le)||a <= b||N/A||5||false
|-
|and||a and b||N/A||5||false
|-
|and||a and b||N/A||N/A||false
|-
|or||a or b||N/A||N/A||false
|-
|or||a or b||N/A||5||false
|-
|+||a + b||N/A||5||false
|-
|-||a - b||N/A||5||false
|-
|*||a * b||N/A||5||false
|-
|/||a / b||5||N/A||false
|-
|()||(a)||N/A|| ||false
|-
|(exp)||(a && b)||N/A||5||false
|-
|(exp) op (exp)||(b + b) > (a && b)||N/A||5||false
|-
|function||sum(a,b,b)||N/A||5||false
|-
|function||max(a,b)||N/A||5||false
|-
|function||min(a,b)||N/A||5||false
|-
|function||implode(', ',a,b,a,b)||N/A||5||false
|-
|function||if(a,a,b)||N/A||5||false
|-
|function||is_empty(a)||N/A|| ||false
|-
|function||is_empty(a)||0 (or blank)|| ||true
|-
|function||!is_empty(a)||N/A|| ||false
|-
|
|}

===Overriding Cascading Conditions===

Say you want to show a running total of all relevant answers. You might try to use the equation {sum(q1,q2,q3,...,qN)}. However, this gets translated internally to LEMif(LEManyNA('q1','q2','q3',...,'qN'),'',sum(LEMval('q1'),LEMval('q2'),LEMval('q3'),...,LEMval('qN')). So, if any of the values q1-qN are irrelevant, the equation will always return false. In this case, the sum() will show 0 until all questions are answered.

To get around this, each variable can have a ".NAOK" suffix (meaning that Not Applicable is OK) added to it. In such cases, the following behavior occurs. Say you have a variable q1.NAOK
#q1 is not added to the LEManyNA() clause
#LEMval('q1') will continue to check whether the response is relevant, and will return '' if it is not (so individual irrelevant responses will be ignored, but they will not void the entire expression.

So, the solution to the running total problem is to use the equation sum(q1.NAOK,q2.NAOK,q3.NAOK,...,qN.NAOK).

The use of the .NAOK suffix also lets authors design surveys that have several possible paths but then converage on common paths later. For example, say subjects answer a survey in a way that is outside the normal range of responses. The author could alert the subjects that they may not get valid results, and ask them whether they really want to continue with the survey. If they say Yes, then the rest of the questions will be shown. The condition for the "rest of the questions" would check whether the initial responses were answered within the normal range OR whether the subject said Yes to the question that is only relevant if they answered outside the normal range.

==How does Expression Manager Support Conditional Micro-Tailoring?==

Here is an example of micro-tailoring (where Question Type=='expr' means an Equation):

{|
|Question Code||Relevance||Question Type||Question
|-
|name||1||text||What is your name?
|-
|age||1||text||How old are you?
|-
|badage||!is_empty(age)||expr||{(age<16) or (age>80)}
|-
|agestop||badage||message||Sorry, {name}, you are too {if( (age<16),'young',if( (age>80),'old','middle-aged') ) } for this test.
|-
|kids||!badage||yesno||Do you have children?
|-
|parents||1||expr||{!badage && kids=='Y'}
|-
|numKids||parents||text||How many children do you have?
|-
|kid1||parents && numKids >= 1||text||How old is your first child?
|-
|kid2||parents && numKids >= 2||text||How old is your second child?
|-
|kid3||parents && numKids >= 3||text||How old is your third child?
|-
|kid4||parents && numKids >= 4||text||How old is your fourth child?
|-
|kid5||parents && numKids >= 5||text||How old is your fifth child?
|-
|sumage||1||expr||{sum(kid1.NAOK,kid2.NAOK,kid3.NAOK,kid4.NAOK,kid5.NAOK)}
|-
|report||parents||yesno||{name}, you said you are {age} and that you have {numKids}. The sum of ages of your first {min(numKids,5)} kids is {sumage}
|-
|
|}

All of these questions can be on a single page (e.g. in the same group), and only the relevant questions will display. Moreover, as you enter the ages of children, the sum() expression in the last question will dynamically update on the page.

Expression Manager provides this functionality by surrounding each expression with a named <span> element. Every time a value changes, it recomputes the expression that should appear in that <span> element and regenerates the display. You can have dozens, or even hundreds, of such tailored expressions on the same page, and the page will re-display all of them in a single screen refresh.

==Mapping of LimeSurvey 1.91+ to Expression Manager Functionality==

{|
|Old Feature||New Feature||Comments
|-
|Conditions||Relevance||You can use very complex conditional equations, and access a broader range of variables
|-
|Assessments||Equation||Any assessment scores can be re-structured into an Equation. This both ensures that the score is written to the database, and also lets you see dynamic changes to the score value on the current page
|-
|Replacements||Expression Manager||The core engine takes the input string and treats everything within curly braces as an Expression - so it handles all historical replacements types. To avoid messing up embedded JavaScript, Expression Manager only processes content between curly braces as long as (a) there is no leading or trailing whitespace within the curly braces - e.g. {expr} is an expression, but { expr}, {expr }, and { expr } are not expressions. Furthermore, Expression Manager does not process content within its own strings (e.g. {list('hi','there {braces}'} generates "hi there {braces}"). It also ignores escaped curly braces (e.g. \{this is not an expression\})
|-
|Validation||Expression Manager||The plan is to take the current min/max Question Attributes and have Expression Manager process them. That way the min/max values can be expressions themselves
|-
|
|}

=Syntax Highlighting=

To help with entering and validating expressions, EM provides syntax highlighting with the following features:

==Types and Meanings of Syntax Highlighting==

{|
|Color||Sample||Meaning||Tooltip||Comments
|-
|tan background||<span style='color:#eee8aa,#eee8aa'>Sample</span>||the whole equation||none||Anything within curly braces that is recognized as an equation (e.g. there is no leading or trailing whitepace) will be color-coded with a tan background to help distinguish it from surrounding text
|-
|blue bold text||'''<span style='color:blue,#eee8aa'>Sample</span>'''||function name||meaning and allowable syntax||function names, or things that should be functions since they are followed by an opening parenthesis, are presented in bold blue text. Tooltips show the meaning and allowable syntax for the function.
|-
|grey text||<span style='color:grey,#eee8aa'>'Sample'</span>||string||none||single and double-quoted strings are shown in grey text
|-
|bold maroon text||'''<span style='color:maroon,#eee8aa'>Sample</span>'''||variable set on the same page, but after the current question||<nowiki>[</nowiki>name or SGQA code]: question; value; answerList showing codes for each value||Any variable that is set on the same page but after the current question is shown in bold maroon text. This color coding should alert authors to possible errors in question sequencing; but it is allowed since some authors may want this sequence of variables a page, especially for dynamic reports. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is show.
|-
|bold cyan text||'''<span style='color:#4C88BE,#eee8aa'>Sample</span>'''||variable set on the same page, prior to the current question||<nowiki>[</nowiki>name or SGQA code]: question; value; answerList showing codes for each value||Any variable that is set on the same page and prior to the current question is shown in bold cyan text. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is show.
|-
|bold green text||'''<span style='color:green,#eee8aa'>Sample</span>'''||variable set on a prior page||<nowiki>[</nowiki>name or SGQA code]: question; value; answerList showing codes for each value||Any variable that is set on a prior pageis shown in bold green text. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is show.
|-
|bold pink text||'''<span style='color:#FF00FF,#eee8aa'>Sample</span>'''||variable set on a later page||<nowiki>[</nowiki>name or SGQA code]: question; value; answerList showing codes for each value||Any variable that is set on a prior pageis shown in bold pink text. These are erorrs since the variable is being used before it is declareed. The tooltip shows its name (if you used INSERTANS:xxx) or SGQA code (if you used the new naming system), the actual question, and its current value (or blank if not set). If the question type expects responses from an enumerated value set, the mapping of the codes to display values is show.
|-
|bold tan text||'''<span style='color:#996600,#eee8aa'>Sample</span>'''||a lime relacement value||the value||Lime Replacement Strings (like {TOKEN:xxx}, {PRIVACY_MESSAGE} are shown in bold tan text. The tooltip shows the current value.
|-
|red text||'''<span style='color:red,#eee8aa'>Sample</span>'''||assignment operator||warning message||If you use one of the assignment operator (=) that operator will be displayed in red text. This is meant to help prevent accidental re-assignment of values when you really meant to check whether a == b instead of setting the value of a = b.
|-
|normal black text||<span style='color:black,#eee8aa'>Sample</span>||punctuation||none||All other punctionation within the expression is shown as normal black text.
|-
|red-boxed text||a bold red line surrounds the error||syntax error||description of the error||Any detected syntax errors are shown by surrounding the error with a red box. The tooltip shows the error. Examples include unmatched parentheses, use of undefined functions, passing the wrong number of arguments to functions, poorly structured expressions (e.g. missing operators between variables), trying to assign a new value to a read-only variable, trying to assign values to non-variables, or using unsupported syntax. Note that the syntax error dectection system may only report one error in an expression even if there are multiple errors; however, if any errors are detected, at least one error will be shown.
|-
|
|}

=Relationship to LimeSurvey Ideas / Feature Requests=

Expression Manager provides complete or partial solutions to each of the following:
*[http://ideas.limesurvey.org/ideatorrent/idea/1 Conditions]
*[http://ideas.limesurvey.org/ideatorrent/idea/3/ Answercounts]
*[http://ideas.limesurvey.org/ideatorrent/idea/5 Advanced reporting for assessments]
**partial: Equations let one store the Assessment value in the database, and micro-tailoring can generate simple formatted reports. Authors can access those Equation values if they have more complex reporting needs.
*[http://ideas.limesurvey.org/ideatorrent/idea/6 Assessment reports]
**partial: Since Equations store the Assessment score, it should be possible to use Statistics to show distributions of those scores, and Quotas to limit the number of responses with those scores.
*[http://ideas.limesurvey.org/ideatorrent/idea/7 Store assessment results for further evaluation]
**Equations let one store the Assessment value in the database, completely solving this problem
*[http://ideas.limesurvey.org/ideatorrent/idea/22/ More advanced condition rules]
*[http://ideas.limesurvey.org/ideatorrent/idea/28 Open Answertable up so that we can alter formatting]
**partial: All of the question attributes are available, so authors can create custom AnswerTable equivalents as a Question. Once implatemented, they can also use the showTheseResponses() or showAllResponsesExecpt() functions
*[http://ideas.limesurvey.org/ideatorrent/idea/37 Export survey results with full questions to include images]
**since Tailoring has access to the full question text, it can include images in the export
**if subjects choose Print Your Answers after finishing the survey, those printouts will be fully tailored
*[http://ideas.limesurvey.org/ideatorrent/idea/63 List of question codes and SGQA identifiers]
**The Show Survey Logic view shows that mapping (plus much more information)
**In addition, you no longer have to use SGQA codes to refer to variables - you can use the Question code/title.
*[http://ideas.limesurvey.org/ideatorrent/idea/69 Branch/jump to another question (earlier or later) based on current question]
**You can use the Navigation Index for this in most cases
**Once implemented, you can use the JumpTo() function. Like the Navigation Index, if you try to jump forward, it will stop on an intervening page if there are any of the relevant mandatory questions are unanswered, or if any relevant questions fail validation tests.
*[http://ideas.limesurvey.org/ideatorrent/idea/86 set quota for total responses]
**If the final question is an Equation that flags a survey as completed (so is NULL if a respondant does not get to that page), you can use Quotas on that question to control the number of completed responses.
*[http://ideas.limesurvey.org/ideatorrent/idea/101 Review all conditions]
**The [[Show Logic File|Show Logic File]] view shows this (and much more)
*[http://ideas.limesurvey.org/ideatorrent/idea/105 Review all questions + Review all groups]
**The [[Show Logic File|Show Logic File]] view shows this (and much more)
*[http://ideas.limesurvey.org/ideatorrent/idea/107 How to visualize questions, logic & conditions]
**The [[Show Logic File|Show Logic File]] view shows this (and much more)
*[http://ideas.limesurvey.org/ideatorrent/idea/113 Offline Surveys]
**Running a survey with all of the questions on the same page would let you do off-line data collection (e.g. email the html page and associated JavaScript). However, you would still want a way to submit the results so that they did not get lost. It may be possible to use Save As HTML to save partially completed responses.
*[http://ideas.limesurvey.org/ideatorrent/idea/120 Remove INSERTANS from question text at survey results]
**INSERTANS is no longer needed. You can refer to a variable by its SGQA code (without prefixing it with INSERTANS:), or by its question code.
*[http://ideas.limesurvey.org/ideatorrent/idea/137 Informed Consent and Authorization Functionality]
**You can show show the informed consent on the welcome page, then ask any additional questions needed (to ensure they meet the study inclusion/exclusion criteria), and ask them a Yes/No question whether they give their consent. Then, make all of the remaining questions conditional on that yesNo. For example, if the question is named ''consent'', you would set the relevance to the remaining questions to ''consent == "Y"'' (possibly ''and''ing that with whatever additional conditions you needed to support your branching needs.
*[http://ideas.limesurvey.org/ideatorrent/idea/199 Show codes instead of of answers using INSERTANS]
**{Qcode} returns the code instead of the response text (which you can get via {INSERTANS:SGQA}, or {Qcode.shown}
*[http://ideas.limesurvey.org/ideatorrent/idea/204 Need group mean or calculations for assessments]
**Say you have N variables of which N-X were answered, you could compute the mean of the answered variables as {sum(var1, var2, ..., varN) / count(var1, var2, ..., varN)}
**Computing the mean across a set of respondants would require extension of the Quota functionality.
*[http://ideas.limesurvey.org/ideatorrent/idea/222 To insert a language dependent text]
**Tailoring lets you conjugate verbs and decline nouns in each language
*[http://ideas.limesurvey.org/ideatorrent/idea/225 Surveyors should approve their answers]
**Custom Questions with tailoring, or the showAllResponsesExcept() function will let Surveyors see all of the questions and responses before clicking Submit. If the Navigation Menu option is enabled, it is easy to go back and correct answers.
*[http://ideas.limesurvey.org/ideatorrent/idea/1.92 Suppliment to #answernnXnnXnnn method of targetting form elements]
**You can now refer to questions and answers by their Question Code, so there is no longer a need to modify SGQA values.
*[http://ideas.limesurvey.org/ideatorrent/idea/262 More flexibility with hidden questions]
*[http://ideas.limesurvey.org/ideatorrent/idea/265 Remove specific conditions from multiple questions]
**You can now use Relevance, which is easier to manage than Conditions. If needed, they can all be exported from the database, edited in a spreadsheet, and re-imported.
*[http://ideas.limesurvey.org/ideatorrent/idea/268 Cross Survey Reporting]
**By using question codes that are unique across your surveys and versions, you can consolidate data from multiple surveys and/or compare them
*[http://ideas.limesurvey.org/ideatorrent/idea/275 Simplifying integration with other tools]
**Expression Manager uses Question Codes instead of SGQA, making it easier to integrate with other tools.
*[http://ideas.limesurvey.org/ideatorrent/idea/1.92 Expose assessment score to 3rd party app processing]
**This can be done with Equation question type
*[http://ideas.limesurvey.org/ideatorrent/idea/309 Multiple thank you pages]
**This can be supported via conditional relevance branching and tailoring

=Additional Reading=

==[[Expression Manager Sample Surveys|Expression Manager Sample Surveys]]==

==[[Expression Manager HowTos|Use Cases and HowTos]]==

==[[Expression Manager Examples|Step-by-Step Examples]].==

==[[Expression Manager for developers|Reference for Developers]]==

==[[Expression Manager Roadmap|RoadMap/Status/ToDo List]]==