I can't scrape a website

[John_Betong]

@SamuelCalifornia

The data appears to be generated dynamically so a simple curl would not get it.

Yes I tried with my Curl utility and was unable to fetch the data but works ok with other sites that are not programmed to prevent scraping:

Jb-Curl

Source code is included.

Internal error on target site using curl but not browser

Hello (my username used to be johnyboy but it wasn’t possible for me to log in with that anymore, so have created a new account…) I’m using curl to access programme pages on BBC’s site (to extract track listings) – have been doing this for a while and all’s been well. Now, I get an internal error on their site when using curl but not when using my browser. I don’t know if this is a programming/server set up mistake on their part or if it’s a slightly surreptitious way of blocking curl request…