How many products in your website? And how many attributes on each product? I believe you can optimize wordpress to make it faster. Or maybe your hosting doesn't support well to run wordpress.
Other than that, you can try to run OpenCart on your server to see if it 's fast or not.