| | Machine Learning (Theory) » ROC vs. Accuracy vs. AROC (Site not responding. Last check: 2007-11-03) |
 | | The ROC vs. accuracy discussion is often conflated with “is the goal classification or ranking?” because ROC curve construction requires a ranking be produced. |
 | | Although the area under the ROC curve (AROC) is not an intuitive quantity in itself, I find that its interpretation as a Wilcoxon-Mann-Whitney statistic, which effectively measures the fraction of positive-negative instance pairs that are ranked correctly (discussed, for example, in Corinna Cortes and Mehryar Mohri’s paper), makes the quantity easier to understand. |
 | | One important method not yet mentioned in the present discussion is the elegant work by Provost and Fawcett on the ROC Convex Hull as an alternative to both “vanilla” ROC curves and the Area Under Curve summary. |
| hunch.net /index.php?p=21 (1065 words) |