Wordpress is a big bloated script. A 3 second load time (from the time you hit the Enter key to when the site renders in your browser) is quite reasonable. But that isn't the problem with your site.
Given how much stuff your site is pulling in, I think it loads very fast. And I don't know what kind of Wordpress plugins you might be using, which will cause even longer load times.
I don't think it's your hosting, either. I don't think you have much of a problem at all given how many requests your site makes to CSS and JS files. Your site loads acceptably fast everything considered.