To me it sounds like you have the Call audio connected, but not the Media audio. My S4 will often hook up the Call audio to my car and the Media audio to my Bluetooth headset (which is wrong), then correct itself and connect Call and Media audio to my car..

Bluetooth Auto Connect app may be able to help you out too once you pair the device to your HU again.