SitePoint Sponsor

User Tag List

Results 1 to 8 of 8
  1. #1
    SitePoint Zealot
    Join Date
    Jun 2004
    Location
    boston, ma
    Posts
    149
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Question "googled" database

    Hi Folks,

    Can a database, such as MySQL, be indexed by search engines such as Google and Yahoo? If no, can a database be made "searchable"?

    Thanks.

    Vanessa

  2. #2
    SQL Consultant gold trophysilver trophybronze trophy
    r937's Avatar
    Join Date
    Jul 2002
    Location
    Toronto, Canada
    Posts
    39,250
    Mentioned
    59 Post(s)
    Tagged
    3 Thread(s)
    no, only a web site can be spidered, but the web site can of course be database-driven

    what you need is a "site map" type of page which contains a link to every dynamic page

    so even if you have a hundred products for sale but there's only one web template that produces a product page using database content, you can get each product spidered and into the search engine as long as there's a link to it somewhere that the spider can follow
    rudy.ca | @rudydotca
    Buy my SitePoint book: Simply SQL
    "giving out my real stuffs"

  3. #3
    SitePoint Zealot
    Join Date
    Jun 2004
    Location
    boston, ma
    Posts
    149
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Examples

    Hi,

    Can you give me the url of sites that have such site maps?

    Thanks.

  4. #4
    SQL Consultant gold trophysilver trophybronze trophy
    r937's Avatar
    Join Date
    Jul 2002
    Location
    Toronto, Canada
    Posts
    39,250
    Mentioned
    59 Post(s)
    Tagged
    3 Thread(s)
    i would if i knew of any, but i don't go looking at product sites very often
    rudy.ca | @rudydotca
    Buy my SitePoint book: Simply SQL
    "giving out my real stuffs"

  5. #5
    SitePoint Member
    Join Date
    Feb 2005
    Posts
    5
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Smile SE Friendly DBDriven website

    Spiders/Crawlers like GoogleBot will avoid Database driven site coz they can get trapped in an infinite loop (leading to your www-server crashing ).
    The crawlers avoid links like http://www.sokobay.com/digdb?id=235. So you need to "trick" the spider to get it indexing your site, though DB driven
    How?
    You need to use mod_rewrite (an Apache module) to redirect query-stringed URLs to static-content URLs
    e.g. http://www.sokobay.com/digdb?id=235 becomes http://www.sokobay.com/digdb/235

    This is part of making your www search engine friendly.

    Hope it helps

    Ref: See Mod_rewrite Resources

  6. #6
    SQL Consultant gold trophysilver trophybronze trophy
    r937's Avatar
    Join Date
    Jul 2002
    Location
    Toronto, Canada
    Posts
    39,250
    Mentioned
    59 Post(s)
    Tagged
    3 Thread(s)
    actually, the crawlers avoid links with session ids and other bumph in the url, but with a simple id, they spider those pages just fine

    here are some counts using the "allinurl" option in google

    allinurl:.asp?id= 50,100,000 results
    allinurl:.cfm?id= 20,500,000 results
    allinurl:.jsp?id= 5,360,000 results
    allinurl:.php?id= wtf? hey guys, check this out
    rudy.ca | @rudydotca
    Buy my SitePoint book: Simply SQL
    "giving out my real stuffs"

  7. #7
    Employed Again Viflux's Avatar
    Join Date
    May 2003
    Location
    London, On.
    Posts
    1,127
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by r937
    allinurl:.php?id= wtf? hey guys, check this out
    Hey...that's neat.

    Looks like an old page too.

  8. #8
    Massimiliano Bruno Giordano sid egg's Avatar
    Join Date
    Aug 2004
    Location
    Canada
    Posts
    1,280
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Quote Originally Posted by Viflux
    Hey...that's neat.

    Looks like an old page too.
    A LOT of things containing the letters php (try powered by phpbb) cause that error because of the phpBB virus
    GamesLib.com - the slickest, most complete and
    easily navigatible flash games site on the web.


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •