SitePoint Sponsor

User Tag List

Results 1 to 8 of 8
  1. #1
    SitePoint Member
    Join Date
    Aug 2012
    Posts
    3
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Pulling latest arrests on Website

    Wanted to see if it's possible to pull latest arrests on a website. For instance, I'm interested in pulling latest arrests from the city of Charlotte, NC onto "crimeincharlotte.com":

    <snip/> (I'd like to have this information displayed on "crimeincharlotte.com")

    Is it a widget that I need to find or is it something that needs to be handled directly with the Police Department and ask for permission and have them send some sort of rss feed to the website.

    Thanks.
    Last edited by Mittineague; Aug 6, 2012 at 10:51. Reason: removing unnecessary link

  2. #2
    Community Advisor silver trophy

    Join Date
    Nov 2006
    Location
    UK
    Posts
    2,551
    Mentioned
    40 Post(s)
    Tagged
    1 Thread(s)
    Check the terms and conditions of use for the information on the source website you have in mind before proceeding. It would be inadvisable to actually become one of the crimes you plan on reporting

  3. #3
    SitePoint Zealot Sogo7's Avatar
    Join Date
    May 2011
    Posts
    129
    Mentioned
    1 Post(s)
    Tagged
    0 Thread(s)
    Fascinating.. I've just been looking at mugshots for todays collection of offenders at http://arrestinquiryweb.co.mecklenburg.nc.us
    do all US police departments have similiar websites?

    Anyhow...
    Seems the information is public domain, however...
    the link for sites terms & conditions of useage is broken
    so would suggest you consult the PD and a lawyer first.

    As for a widget to fetch the site data, yes it can be done.
    Lovelogic.net Personal Projects Pit - Spammers welcome

  4. #4
    SitePoint Wizard bronze trophy
    Join Date
    Jul 2006
    Location
    Augusta, Georgia, United States
    Posts
    4,147
    Mentioned
    16 Post(s)
    Tagged
    3 Thread(s)
    Good luck finding a feed of any kind. You will probably need to write a custom processing script to scrape the pages and field it into something meaningful. We are working on something similar to find that every county seems to have a different way of doing things. The best thing you can do is create adapters and normalize on your own end w/ a good HTML parser library because most of the pages are complete gibberish with broken, invalid mark-up. Though you might get lucky if you are only dealing with a single source, they might even have a feed (doubtful).
    The only code I hate more than my own is everyone else's.

  5. #5
    SitePoint Member
    Join Date
    Aug 2012
    Posts
    3
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    thanks for the reply Sogo7, I think some Police departments have different websites for their work..like each department have their own way of doing things.

  6. #6
    SitePoint Member
    Join Date
    Aug 2012
    Posts
    3
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)
    Thanks for the reply odds, sounds pretty complicated to do it..I thought it was some kind of widget or plugin since I see more and more of those mugshots sites around the web.

  7. #7
    SitePoint Wizard bronze trophy
    Join Date
    Jul 2006
    Location
    Augusta, Georgia, United States
    Posts
    4,147
    Mentioned
    16 Post(s)
    Tagged
    3 Thread(s)
    This is an area the government is lacking. There *really should be a gov site for central location of all bookings. but yeah... it is pretty much left up to the individual counties with no normalization.
    The only code I hate more than my own is everyone else's.

  8. #8
    SitePoint Zealot Sogo7's Avatar
    Join Date
    May 2011
    Posts
    129
    Mentioned
    1 Post(s)
    Tagged
    0 Thread(s)
    For what it's worth I took a look at http://arrestinquiryweb.co.mecklenburg.nc.us/ with a Yahoo Pipe RSS creator and that's pretty easy to use even for a novice with no coding skills. It encountered no problems getting at the data, the search URL can be entered directly and the page fetched without any need for creative workarounds. Other PD sites of course may vary and whilst you may not get the latest booking details things like missing persons or most wanted pages are pretty common features for many of the ones I skimmed through.
    Lovelogic.net Personal Projects Pit - Spammers welcome


Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •