SitePoint Sponsor

User Tag List

Results 1 to 5 of 5

Thread: How does....

  1. #1
    SitePoint Zealot Ace Nova's Avatar
    Join Date
    Aug 2000
    Posts
    197
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    I am interested in creating a search engine but i dont know where to start. What i want to know is how do search engines do it.

  2. #2
    Your Lord and Master, Foamy gold trophy Hierophant's Avatar
    Join Date
    Aug 1999
    Location
    Lancaster, Ca. USA
    Posts
    12,305
    Mentioned
    1 Post(s)
    Tagged
    0 Thread(s)
    Basically
    The search engines (goto.com, Lycos, Hotbot, Webcrawler, and the like) create specialized databases using MS SQL Server, Sybase (basically the same as SQL Server but for Unix), Informix or Oracle. To fill these databases they ask for submissions and create specialized browsing agents called spiders. The spiders sit on a server and just ping web addresses until they find an actual site. Once they get a site they pull in the default page and then proceed to follow its links. All of these pages are input into the database for later querying.

    Each search engine has its own proprietary searching and sorting algorithms to display your searches. Naturally they are rather reluctant to disclose these pieces of code.

    Building a personal Engine
    Things are not that difficult for the webmaster these days if they want to add similar capabilities to their sites. To start you can download the data from the Open Directory Project using something like Anaconda Open Directory or POD written in PERL or you can write a script that pulls the information fairly simply in ASP and PHP using prebuilt components and/or modules.

    ------------------
    Wayne Luke - Sitepoint Forums Administrator
    Digital Magician Magazine - MetaQuark Creations (Coming Soon)
    sitepoint@digitalmagician.com

  3. #3
    SitePoint Zealot Ace Nova's Avatar
    Join Date
    Aug 2000
    Posts
    197
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Is there any better ways to make a search engine, keep in mind i already know about everyone.net

    ------------------
    Webmaster
    www.supernovanetworks.com

  4. #4
    Your Lord and Master, Foamy gold trophy Hierophant's Avatar
    Join Date
    Aug 1999
    Location
    Lancaster, Ca. USA
    Posts
    12,305
    Mentioned
    1 Post(s)
    Tagged
    0 Thread(s)
    There are hundreds of scripts to choose from to build a search engine in many languages. You can check out CGI Resource Index, ASPin, PHP Builder and other script repositories.

    If you want an engine hosted by a third party I would recommend Atomz over Everyone.net

    ------------------
    Wayne Luke - Sitepoint Forums Administrator
    Digital Magician Magazine - MetaQuark Creations (Coming Soon)
    sitepoint@digitalmagician.com

  5. #5
    SitePoint Zealot Ace Nova's Avatar
    Join Date
    Aug 2000
    Posts
    197
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Need someone to guide me through the process

    ------------------
    Webmaster
    www.supernovanetworks.com


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •