Now we are going to ask some questions about:

• The Selection Criteria window
• Matching Items window
• The Ranked Items window
• The Considered Items window
• The Trade-off Analysis window
• And some final questions

Click next to start. You can see the Criteria Selection window highlighted in this picture.



We are going to ask about:

• Setting a criterion
• Using the weights

Click next to continue. For each of the statements below, please indicate the degree of your agreement with the statement by selecting the appropriate choice. Without taking into account the weights, The interaction with the Selection Criteria window was clear and understandable The Selection Criteria window was useful I would like the possibility to set the importance of each criterion To set the value of a criterion of an ordered attribute

(maximum price, matriculated after, minimum performace...)

I prefer to: Comments For each of the statements below, please indicate the degree of your agreement with the statement by selecting the appropriate choice. Interacting with the weights was often frustrating It was easy to decide the proper weight Changing the weights often resulted in an unexpected ordering of the Ranked Items Overall, I found the weights easy to use For each of the statements below, please indicate the degree of your agreement with the statement by selecting the appropriate choice. The use of weights was useful to get a good "picture/understanding" of the different possibilites for my region of interest The use of weights was useful for accomplishing the task



Comments about the weights You can see the Matching Items window (hereafter we call it the Items window) highlighted in this picture.



You can see the Ranked Items window (hereafter we call it the Items window) highlighted in this picture.







For each of the statements below, please indicate the degree of your agreement with the statement by selecting the appropriate choice. I often became confused when I looked at the Items window There was too much information in the Items window The Items window was easy to use to accomplish the task For each of the statements below, please indicate the degree of your agreement with the statement by selecting the appropriate choice. I found the Items window useful for accomplishing the task I prefer to see all the matching items in the Items window (with the scroll bar) than to see only the first 3 items I prefer to see all the items in the Items window (with the scroll bar) than to see only the first 3 items The possibility to sort the items by a column was useful When there were not matching items, no items were displayed in the Items window.

In this situation, you would prefer that the system displays partially matching items.

. I would like the system to rank somehow the items in the Items window

(put the best candidates on the top of the list) Having the items ranked was useful When there were not matching items, patially matching items were displayed.

I found this useful. Even if there were matching items, patially matching items were also displayed (after the matching items).

I found this useful. I would like to have the possibility to sort the items by a column Discerning between matching items and partially matching items was useful Having the unsatisfying attribute values displayed in red was useful I found that the Items window was more useful for accomplishing the task than in the first system



Comments about the Items window You can see the Considered Items window highlighted in this picture.







For each of the statements below, please indicate the degree of your agreement with the statement by selecting the appropriate choice.

My interaction with the Considered Items window was easy for me to understand Overall, I found the Considered Items window useful for accomplishing the task If you did use the Considered Items window, why did you use it? Comments about the Considered Items window You can see the Trade-off Analysis window (hereafter we call it the TA window) highlighted in this picture.







For each of the statements below, please indicate the degree of your agreement with the statement by selecting the appropriate choice. Interacting with the TA window was often frustrating The TA window often behaved in unexpected ways I found it easy to read and understand the information provided by the TA window Overall, I found the TA window easy to use For each of the statements below, please indicate the degree of your agreement with the statement by selecting the appropriate choice. The TA window was useful to get a good "picture/understanding" of the different possibilites for my region of interest The TA window was useful for accomplishing the task Here we show you again the image presented in the tutorial about the Trade-off Analysis window.

Just click Next to Continue.







For each of the statements below, please indicate the degree of your agreement with the statement by selecting the appropriate choice.

Some questions about the "Strong Relaxations": I found it easy to read and understand the "Strong Relaxations" information I found reading the "Strong Relaxations" useful for accomplishing the task I found clicking on the "Strong Relaxations" useful for accomplishing the task

Some questions about the "Conflicting Set" information: I found it easy to read and understand the "Conflicting Set" information I found the "Conflicting Set" information useful for accomplishing the task

Some questions about the "Weak Relaxations": I found it easy to read and understand the "Weak Relaxations" information I found reading the "Weak Relaxations" useful for accomplishing the task I found clicking on the "Weak Relaxations" useful for accomplishing the task

Comments about the Tradeoff Analysis window Thanks. Now we are going to ask some final questions about the system. Note: When we say "the system", we refer to the improved system.

What did you like most about the system? What did you like least about the system? Would you recommend the system to a friend? In which other domains would you like to use this type of system?

(music, movies, apartments, jobs...) If you have any other comments about the system (or the experiment itself), or advice on how to improve it, please provide them in the space below. Would you agree to evaluate futur versions of the system once we have made improvements? Would you like to be informed about the results of the study? If you answered "yes" to any of the last two previous questions, please provide your email The questionnaire has finished.

Click "Finish" to continue.