Jump to content

Automatical Site Search Based On (Sub)Folders Name

- - - - -

This topic has been archived. This means that you cannot reply to this topic.
12 replies to this topic

#1
PTaab

PTaab

    Newbie

  • Members
  • PipPip
  • 15 posts
Hi everyone

As the name of the topic says, I wonder if adding unlimited page tabs based on folder's (including subfolders) name is possible? What I mean is - when you want to check if the files in the folders are correct (names, number of files, their positions and so on) with some trustworthy offical web site with huge database, you need to type what you search for, choose what is found and in the third step, you can see if your files in the folder are correct. I believe in at least 99% of times the searching keywords are the same as folder names. Is it possible to do this process (do the search and open the result depending on folder and subfolder name) automatic which would be very useful in case of higher amounts of folders that need to be checked so the tabs (pages from the site) inside the internet browser would be opened automatically? The web site that I had in my mind is discogs but the process would be the same for any other site (amazon etc).

I think it would be still better to make this topic in the web section because the programmers, who create softwares related to web sites, usually check posts there but the forum rules, or to better say, the description of forum subsections made me add this post on another location.

Best wishes.

#2
WingedPanther

WingedPanther

    A spammer's worst nightmare

  • Moderators
  • 16,831 posts
I have a feeling you have a lot of incorrect assumptions here. Have you considered using a web spider?
Programming is a branch of mathematics.
My CodeCall Blog | My Personal Blog

#3
PTaab

PTaab

    Newbie

  • Members
  • PipPip
  • 15 posts
Thank you for reply. Why do you mean I presumed wrong how this process would be done? I have never used web spider. You probably meant this www dot jocsoft dot com/jws/
I used to read the functions of the software. However, I cannot save the web sites to hard drive - no matter how big the file would be. The reason is simply - not enough space on hard drive. If you save two or three web sites, its no problem but what if you have to open several hundreds tabs / pages. The purpose is to gather the links, one by one, as fast as possible and switch them to next link by copy / paste (clipboard) wherever needed.
I cannot really imagine how this software/script would be programmed - I guess its really hard to do this because sometimes the folder's and file's names contain totally unnecessary parts of the names, sometimes is only a piece that equals to lets say 20% of the whole name length useful and can be count as the real name of the file and a folder, the other 80% part of the name are useless additions such as year of creating the folder, name of the person who created it and many other totally useless symbols.
About this web spider - I doubt if is really able to read the name of the (sub)folders and even files and use this name (for example with three keywords; one from folder, one from subfolder and one from random file inside the subfolder) as the searching keywords.

p.s.: I know Im not fluent in English language but would just like to make sure that we mean the same with the word ''tab'': for example here are 10 tabs added: www dot dmxzone dot com/downloads/images/firefox3_tab dot jpg

#4
WingedPanther

WingedPanther

    A spammer's worst nightmare

  • Moderators
  • 16,831 posts
What I'm thinking is not that you would save the sites, but just whether there was success or failure for the files. What you're describing is what a spider does, minus saving the file.

The reason I think you have an issue is that not all websites operate on the file/folder concept, and even those that appear to may be doing something very different.
Programming is a branch of mathematics.
My CodeCall Blog | My Personal Blog

#5
PTaab

PTaab

    Newbie

  • Members
  • PipPip
  • 15 posts
Its not file/folder concept. Its just moving their names and using them as a search keywords. I will try what you suggested - web spider. Hopefully with some additional tutorial it will work. Thank you for your suggestion.

#6
PTaab

PTaab

    Newbie

  • Members
  • PipPip
  • 15 posts
Hmm did you mean JOC Web Spider or Visual Web Spider? I guess those are two different programs.

#7
WingedPanther

WingedPanther

    A spammer's worst nightmare

  • Moderators
  • 16,831 posts
I didn't have a specific web spider in mind.
Programming is a branch of mathematics.
My CodeCall Blog | My Personal Blog

#8
PTaab

PTaab

    Newbie

  • Members
  • PipPip
  • 15 posts
WingedPanther Im sorry for still keeping this topic. I tried what you suggested - Web Spider but I couldn't pass the first step already - adding unlimited amount of folders. Drag & Drop doesn't work in that program, Add Option allows just one folder to be added. Its logical that first step to what is was mentoining is to open all the folders needed, inside the program.

#9
WingedPanther

WingedPanther

    A spammer's worst nightmare

  • Moderators
  • 16,831 posts
Do you have a list of folders already available?
Programming is a branch of mathematics.
My CodeCall Blog | My Personal Blog

#10
PTaab

PTaab

    Newbie

  • Members
  • PipPip
  • 15 posts
Well, I was adding the folders - tried by drag & drop and tried also with opening the folders (File\Open) but still not able to open them all at once.
As you mentoined the list of folders - Yes I do have it. Did you mean the list in text format (txt, doc,...)? If so its no problem to do this. With a bit of CMD knowledge (and I am able to do this), its easy to have all folder names listed in that way, file names would be required too because the Search Keywords will also consist from a name (one file) or two names (two files) as well. But I cannot really imagine how the Web Spider would read correct part of correct each line inside the .doc with the file names.

#11
WingedPanther

WingedPanther

    A spammer's worst nightmare

  • Moderators
  • 16,831 posts
A web spider normally follows links within a website to build it's map. I have a sense that there's something unstated going on that would make this a lot clearer.

Are you saying you have something like a bunch of files all located in a directory like "C:\webfiles\mywebfiles\*" and you want to verify that each one displays when you access it via a url, such as "http://mycompany.com/webfiles/*"?
Programming is a branch of mathematics.
My CodeCall Blog | My Personal Blog

#12
PTaab

PTaab

    Newbie

  • Members
  • PipPip
  • 15 posts
I think its the best if I make one example for one folder (the same process, at the same time, i expect from unlimited amount of folders):

Please look at this link (the site if 100% safe, discogs is one of the most popular sites on the web): click

The link is randomely chosen, there could be billion of other possibilities. So I have the folder with no specific syntax given but with the name lets say ''si - umek - vice grip ep 2008-beatport'' and inside of it i have three files (positions doesn't matter because its all about automatical searching of keywords):
01-vice_grip-bbt
02-combine_fragments-bbt
03-combine_fragments_dachshund_edit

As you can see the folder and the files have some totally unnecessary words added, even changes (''edit'' instead of ''remix''). To go to the page that I showed above and to get it there are 3 steps required to do:
1. go to the site - in our case click (the process about which we speak is the same for each site, with bigger database of whatever, with search box)
2. in the search box i need to type some of the words from folder, and some from the file. In this example the keywords would be ''vice fragments'' (also ''umek combine'' or even ''combine grip'' would be fine) . Of course the search need to be started with one single click - on the button ''Search''
3. the result need to be chosen (with just a few results, lets say three, this step could be done in maximum two seconds with well working server)

I don't need to get on the page to have it opened but my purpose is to get, from the link Discogs, through the link click, as soon as possible this link: click
The program (web spider?) would see the keywords from folder and files (it can be only one file inside too) names automatically, also the search would be automatically. The reason for this is; I need the link for copy / paste process for further needs. Number of gathered links would equal to number of folders added (or number of lines in the text file if this would be made through DIR command). So I would be also able to switch from previouns link to next link (on purpose to copy it for, later, pasting it) as soon as possible.