Jump to content

HTML screen scraping questions

- - - - -

This topic has been archived. This means that you cannot reply to this topic.
2 replies to this topic

#1
xavier1

xavier1

    Newbie

  • Members
  • Pip
  • 1 posts
Hey, guys I just had some questions regarding a script I'm working on. I just started learning PERL so bear with me.

I need to write a script that records all the changes made to a website. These changes are minimal and happen about every 5 minutes. I was wondering:
1. Is PERL a good language to do this?
2. Can this be done with limited knowledge of the language or is it a pretty complex task?
3. Is the learning curve for something like this too steep to make it worthwhile?

I just don't want to start this project and have it turn out to be something that's beyond my capabilities.

Thanks a lot for the help.

#2
hodge-podge

hodge-podge

    Learning Programmer

  • Members
  • PipPipPip
  • 47 posts
Perl is a great language to do it with. It doesn't take much knowledge of perl to do this either, it may take some knowledge of server side scripting though. Does the site use Ajax?

If you are only getting info from the site, and not sending anything, that really shouldn't be to hard.

#3
johnny123

johnny123

    Newbie

  • Members
  • PipPip
  • 10 posts
Are you on the linux background? If yes, you can write a small shell program using sed/awk and then simply run that script on cron. You can use Python or Perl too to do that.