The OP could have been describing me. I only find myself getting any sort of non-neutral response if the piece has some emotional connection to it. That basically means games, because that's where I get most of my soundtrack-backed experiences. There are some songs in movies that move me if they were placed well in a good story.