Contrast polarities determine the direction of Café Wall tilts