Lost Password?

Go Back   CodeCall Programming Forum > Web Development Forum > Perl

Perl Discussion for the PERL language - Practical Extraction and Reporting Language, is a programming language often used for creating CGI programs.

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 05-15-2008, 10:20 AM
suicidal pencil suicidal pencil is offline
Newbie
 
Join Date: May 2008
Posts: 22
Last Blog:
being lazy sucks.
Rep Power: 1
suicidal pencil is on a distinguished road
Default now, how do I...

School is comming to a close, and I'm starting to become overloaded with work. Meaning that I wont have time to check the twenty or so forums I belong to.

I've decided to create a perl script that would go to each and every site, list new posts, alert me to PMs, and then write it into a .txt file.

My question is: how would I go about this? I know how I would write information to a file, but I'm inexperianced with CGI . I'm not actually sure of where to start from.

Could anyone point me in a direction?
__________________
Programming is an art form. Everyone can program, but few can do it right.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote

Sponsored Links
  #2 (permalink)  
Old 05-15-2008, 10:28 AM
v0id's Avatar   
v0id v0id is offline
Super Mod
 
Join Date: Apr 2007
Location: Denmark
Posts: 1,880
Last Blog:
CherryPy(thon)
Rep Power: 23
v0id is a name known to allv0id is a name known to allv0id is a name known to allv0id is a name known to allv0id is a name known to allv0id is a name known to all
Send a message via MSN to v0id
Default Re: now, how do I...

It can be hard to make such script, because forums are made differently and the structure of the underlying HTML is not necessarily the same from forum to forum. I would instead concentrating on the forums providing RSS feeds. In that way you'll only have to care about a single structure.

If you don't want to make a RSS parser yourself, you can use an already existing one. You may want to look into XML::RSS and eventually XML::RSS::Parser::Lite if you want a simpler interface.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 05-15-2008, 11:57 AM
suicidal pencil suicidal pencil is offline
Newbie
 
Join Date: May 2008
Posts: 22
Last Blog:
being lazy sucks.
Rep Power: 1
suicidal pencil is on a distinguished road
Default Re: now, how do I...

There are four sites that I'm worried about.

z11.invisionfree.com/conflagrationV_M_G
z14.invisionfree.com/playr_forums
The Defectors Clan • Index page
and this one.

I know that forums.defectorsclan.com uses PHP, but I'm not entirely sure about this one (I think PHP again...not sure though), and the zx.invisionfree.com/xxxxxx sites are completly unknown to me.
__________________
Programming is an art form. Everyone can program, but few can do it right.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 05-15-2008, 02:04 PM
Jordan's Avatar   
Jordan Jordan is offline
Administrator
 
Join Date: Nov 2005
Location: Hendersonville, NC
Age: 25
Posts: 4,529
Last Blog:
PHP: list()
Rep Power: 50
Jordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud of
Send a message via ICQ to Jordan Send a message via AIM to Jordan Send a message via MSN to Jordan
Default Re: now, how do I...

Most forums have an RSS feed. I'm betting these 3 do and you can find information about this one here: RSS Feeds

Once you figure out the RSS feeds you can then use Perl to fetch the XML and write them to a file. Even better, iGoogle will do this for you as will Outlook and several other clients.
__________________
CodeCall Blog | CodeCall Wiki | Shareware Site | Linux Forum | Write a Blog
Chat with other CodeCall members on IRC; connect to irc.codecall.net and join #codecall
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 05-15-2008, 02:38 PM
suicidal pencil suicidal pencil is offline
Newbie
 
Join Date: May 2008
Posts: 22
Last Blog:
being lazy sucks.
Rep Power: 1
suicidal pencil is on a distinguished road
Default Re: now, how do I...

I'm making this mostly because I think it would be a wicked thing if I achieve it ...but it would also help me decide if I need to make an appearance on a particular site.
__________________
Programming is an art form. Everyone can program, but few can do it right.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote

Sponsored Links
  #6 (permalink)  
Old 05-15-2008, 11:57 PM
v0id's Avatar   
v0id v0id is offline
Super Mod
 
Join Date: Apr 2007
Location: Denmark
Posts: 1,880
Last Blog:
CherryPy(thon)
Rep Power: 23
v0id is a name known to allv0id is a name known to allv0id is a name known to allv0id is a name known to allv0id is a name known to allv0id is a name known to all
Send a message via MSN to v0id
Default Re: now, how do I...

Quote:
Originally Posted by suicidal pencil
There are four sites that I'm worried about.
Both "thedefectorsclan" and CodeCall has RSS feeds. Here they are:

http://forum.codecall.net/external.php?type=RSS2
Latest posts from “The Defectors Clan” board.

I wasn't even able to open the other sites, so I can't say whether they have or not.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old 05-16-2008, 06:12 AM
suicidal pencil suicidal pencil is offline
Newbie
 
Join Date: May 2008
Posts: 22
Last Blog:
being lazy sucks.
Rep Power: 1
suicidal pencil is on a distinguished road
Default Re: now, how do I...

playr.co.uk
Conflagration V M G (<- I think it's PHP <_<)
__________________
Programming is an art form. Everyone can program, but few can do it right.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8 (permalink)  
Old 05-16-2008, 07:53 AM
v0id's Avatar   
v0id v0id is offline
Super Mod
 
Join Date: Apr 2007
Location: Denmark
Posts: 1,880
Last Blog:
CherryPy(thon)
Rep Power: 23
v0id is a name known to allv0id is a name known to allv0id is a name known to allv0id is a name known to allv0id is a name known to allv0id is a name known to all
Send a message via MSN to v0id
Default Re: now, how do I...

It seems like they don't have RSS feeds, at least I haven't found them.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #9 (permalink)  
Old 05-16-2008, 07:55 AM
Jordan's Avatar   
Jordan Jordan is offline
Administrator
 
Join Date: Nov 2005
Location: Hendersonville, NC
Age: 25
Posts: 4,529
Last Blog:
PHP: list()
Rep Power: 50
Jordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud ofJordan has much to be proud of
Send a message via ICQ to Jordan Send a message via AIM to Jordan Send a message via MSN to Jordan
Default Re: now, how do I...

Couldn't find them either. I noticed the first one was Invision Power Board. They would need to install an addon to enable the RSS feed feature.
__________________
CodeCall Blog | CodeCall Wiki | Shareware Site | Linux Forum | Write a Blog
Chat with other CodeCall members on IRC; connect to irc.codecall.net and join #codecall
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #10 (permalink)  
Old 05-17-2008, 08:08 AM
fahlyn's Avatar   
fahlyn fahlyn is offline
Learning Programmer
 
Join Date: Nov 2007
Age: 24
Posts: 35
Rep Power: 3
fahlyn is on a distinguished road
Send a message via ICQ to fahlyn Send a message via AIM to fahlyn Send a message via MSN to fahlyn Send a message via Yahoo to fahlyn
Default Re: now, how do I...

What's wrong with just using the forum's email notification features? Most sites frown on "page scraping"....which is what it sounds like you're trying to do.
__________________
Visit My Google Group Here: Web Development Innovation
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote

Sponsored Links
Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


All times are GMT -5. The time now is 09:36 PM.

Contest Stats

dargueta ........ 93.00000
John ........ 87.50000
Xav ........ 50.00000
MeTh0Dz ........ 20.00000
gaylo565 ........ 18.00000
Johnnyboy ........ 3.00000

Contest Rules

Ads