This question has been asked many, many times. You'll find thorough responses than the one I'm going to give by doing a search on the fora.
My personal opinion is to go with ExpressionEngine. It has a very nice structure, the templating system is top notch, the built-in functionalities are fantastic (minus the gallery and member modules). Many very high quality add-ons. The custom field feature is one-of-a-kind splendid. All in all, EE allows you to built your site any which way you want. You do not get that kind of flexibility with Joomla - at least not the last version I've used, which was horrible.
In other words, I don't think CMSes come much better at that price. EE has many drawbacks and certainly doesn't try to be the "I want to be everything to any task" kind of CMS that Joomla! is. For many tasks, however, EE is an excellent choice. How excellent it is in the end, depends largely on how you built your site with it.