And, please don't use 3rd party tools to fix USB problems...
Open the System applet in the control panel, click advanced system settings to get the system properties window, go to the Advanced Tab, click the Environment Variables button at the bottom. Create a new system environment variable named DEVMGR_SHOW_NONPRESENT_DEVICES and set it to a value of 1.
Then launch Device Manager, go to the view menu, and enable show hidden devices. Windows will now list each and ever stupid driver installed but not actually being used at the time. You can go through all those hives and cleanly uninstall every ghosted icon. This includes busted shadow copies by the way, which can pile up if you're using any sort of real backup.
Thanks for this forgotten tidbit.