Yeah I’ve had similar problems. I use a usb/kvm switch to switch multiple laptops and desktops on a single monitor/keyboard/mouse. There should be a conf file somewhere that lets you set what gets switched when a usb gets plugged/unplugged or when the computer sleeps. I’m on my phone at the moment so I can’t easily look it up right now.