Maybe a brainwave or maybe a pain in the butt......but I was wondering if the modify outputs and busses could be displayed graphically?
A window or dialog type box would display the parts of your audio environment in a similar way to the OSX audio/midi setup.
Maybe individually selecting an output from a popup for the device and it just shows what that output is currently connected to......if you showed them all at once it might be very messy.
Probably not practical but worth a giggle.