Will Google follow those links to other pages. or will Google only follow the links on the initial loading of the webpages html.
Short answer: yes.
Somewhat longer answer:
A while back, Matt Cutts announced via Twitter that Google is now able to “execute AJAX/JS to index some dynamic comments”. Google also made an [URL=“http://googlewebmastercentral.blogspot.de/2011/11/get-post-and-safely-surfacing-more-of.html”]official blog post on the subject which confirms this.
Saying that however, there are certain steps that you can take yourself to make your AJAX site more search engine friendly.
HTH