One sort key: a column, '' until picked, and its direction