View Single Post
  #8 (permalink)  
Old 06-06-2008, 07:06 PM
CygnetGames's Avatar   
CygnetGames CygnetGames is offline
Programmer
 
Join Date: May 2007
Location: York, England
Posts: 113
Rep Power: 6
CygnetGames is on a distinguished road
Default Re: RSS feeds and cURL

Quote:
Originally Posted by Jordan View Post
Good deal! How did you figure it out, trial and error?
It was partly trial and error and partly random luck!

While looking for something different, I found someone on a forum having a similar problem trying to scrape some content from another site and needing to spoof their user agent before the server would like them. I wondered if my problem was the same and it looks like it was.

Here is the finished, working version of the comics page. It pulls the latest comic from both Dilbert and xkcd, caching them every hour on my server.

I might make this into a tutorial, if it continues to work for the next few days without showing any more problems! It's a nice simple example of cURL and degradable ajax.
Reply With Quote