Hold. Tap. Let go.
Hold ⌥ and tap Tab: Flick opens with your windows in order, most recent first, and your previous window already selected. Each tap of Tab moves down, or press ⌥3 to switch straight to the third row. Let go and you're there. A quick tap jumps straight back to the last window.