Discussion of ‘Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment’, part 2

Imai et al.(IJGHS) have conducted a timely experiment on evaluating a decision support algorithm. However, we are concerned by their choice of estimands which, even if they appear plausible at first, rely on notions and assumptions for which we cannot ever obtain empirical evidence. We suggest an alternative.