I can't figure out something. I read 1-2 articles on how it's beneficial using em units over pixel units

What I don't know exactly is it's enough to use em units only with elements involving text? (h1,h2,..,font-size,etc)

Or should I use em unit with every element? div, span, etc...

I want my site to be more accessible for screen readers, etc.