Same for me.
Though it can be relatively safe to assume that a mobile phone has the ability to make telephone calls, it is less certain to assume that other devices can not.
Detecting a users peripherals is venturing into Security issues. Do I want a website to know if I have a microphone, camera, printer, phone etc.?
I suppose you could add an input to the page asking if they can phone and then display the link / text based on that.
Or maybe replace the telephone links with a link to a contact page where a visitor could choose a more recognizable method of communication.
TBH, as long as the phone number is identifiable as a phone number, I find it hard to believe it would confuse that many ( but then again ... ) Even if it caught someone once, it seems it would be a one time thing.