I had that problem too. If the headphones have a mic on them, they won't line up properly. If the plug on the headphones has 2 black rings, they won't work. If there is only one ring, you should be fine. It's a strange issue in that any devices I've ever owned, the two are usually interchangeable. I just used this as an excuse to buy some Bluetooth ear buds!
:EDIT: Perhaps I meant three black rings. In any event, if h they have a Mic or any inline device like play/pause buttons, they don't seem to work.