1 reply to this topic

[fatof]

I've got issue.

I want to grab all links from YT (every god **** link with main domain youtube.com). Is there any tool which can handle this task (just grab links, not download every video and ruin my hdd). I've tried to generate all links to YT, but with alphabet a-Z and digits and with 11 letter string it would be 8x10^19 possibilities so, hm, it would be a lot of disk space, dude. I calculate that it will be over 800 mln terabytes of links - nice. So what I am asking for is a tool which grab links from the site (grab and follow if link is hosted on main domain).

Maybe some of you know where I can found that program/project?

I've searched on google dorks like:

"you tube link grabber"
"youtube links"
"youtube full video list"
...

And 0 results, the only one is httrack, but I don't know how to force him to grab only the links, not images, text data, videos and lots of other stuff.

Help plx :D.

[WingedPanther]

One major issue you will encounter: the list may be growing faster than you can collect it. If you collect the A's first, by the time you finish the B's there will be new A's.

What you are trying to build is a web spider.