Jump to content

Spider/Crawler

- - - - -

  • Please log in to reply
2 replies to this topic

#1
Bioshox

Bioshox

    Programming Professional

  • Members
  • PipPipPipPipPip
  • 207 posts
Would it be possible to develop a Spider/Crawler that crawled Web Pages, and then pinged services such as Google etc?

Would this be possible to develop??

#2
__ak

__ak

    Newbie

  • Members
  • PipPip
  • 24 posts
Yes it is possible to make php script that crawls webpages.
You'll need to look at some reqular expressions; PHP: preg_match - Manual

About pinging services - what do you mean exactly?
You could try to socket connect to the service to see if you get any answer?

#3
so1i

so1i

    Programming Professional

  • Members
  • PipPipPipPipPip
  • 312 posts
Yes, definitely possible. Regular expressions are important as already said, and I would also check out the PHP cURL libraries! :)
My Company - My Homepage - My Twitter - My Google+ - My LinkedIn

"Things don’t have to change the world to be important.” - Steve Jobs




1 user(s) are reading this topic

0 members, 1 guests, 0 anonymous users