I created a spider about 2 years ago and never did anything with it. Unitl now, I fixed it up and run the script. While being up for 16 hours I fell to sleep and forgot about it.

I woke up to find it was still going and had spidered 3.12 million sites. The results look good from a general point of view but nothing solid.

My question is, can MySQL and php run a small search engine with this many (3.2million) links and sell be fully functional?

I have a dedicated server with webair. MySQL is currently at 2.4GB used.