Just accidently discovered something.
Normally, Alt+Tab is enough to switch windows.
But if you have alot of windows open and you need to navigate between them, you can use Ctrl+Alt+Tab to keep the switcher open, even after you let go of the Alt key.