Dynamic Experiments for Estimating Preferences: An Adaptive Method of Eliciting Time and Risk Parameters
Coauthor(s): Olivier Toubia, Theodoros Evgeniou, Philippe Delquie.
We present a method that dynamically designs elicitation questions for estimating preferences, focusing on the parameters of cumulative prospect theory and time discounting models. Typically these parameters are elicited by presenting decision makers with a series of choices between alternatives, gambles or delayed payments. The method dynamically (i.e., adaptively) designs such choices to optimize the information provided by each choice, while leveraging the distribution of the parameters across decision makers (heterogeneity) and capturing response error. We use an online experiment to compare our approach to a standard approach used in the literature that requires comparable task completion time. We assess predictive accuracy in an out-of-sample task and completion time for both methods. For risk preferences, our results indicate that the proposed method predicts subjects' willingness to pay for a set of out-of-sample gambles significantly more accurately, while taking respondents about the same time to complete. For time preferences, both methods predict out-of-sample preferences equally well while the proposed method takes significantly less completion time. For risk and for time preferences, average completion time for our approach is approximately three minutes. Finally, we briefly review three studies that used the proposed methodology with various populations, and discuss the potential benefits of the proposed methodology for research and practice.
Source: Management Science
Toubia, Olivier, Eric Johnson, Theodoros Evgeniou, and Philippe Delquie. "Dynamic Experiments for Estimating Preferences: An Adaptive Method of Eliciting Time and Risk Parameters." Management Science (forthcoming).