That's my biggest issue so far. With RDP I knew I could hook up my cheap Android Tablet on my private network and RDP my way to stuff I forgot to do or I needed urgently. Now I can do similar things with SSH but I still struggle to use VNC without it breaking my gdm, and not even to the full extent I'd wish for.