4 replies to this topic

[yeto]

I am new to programming.

I want to build a search engine that when keywords are entered in the search field the software will search Google, Yahoo, and Bing. I then want the software to search specific parts of the pages it finds using the same keywords and then list the websites from all three search engines in one place.

Is this possible and which programming language/software would be the best to use?

Thanks in advance for any help,
yeto

[WingedPanther]

It's possible, but has already been done. Dogpile.com, for example, does this. Any server-side language should work.

[Alexander]

Any language can be used more or less that contains HTTP interacting although I would recommend a comfortable web language (it is more accessable) such as ASP.NET or PHP.

The three search engines you listed do not allow spidering of their results, but they hand out APIs to access search results:
Yahoo: Yahoo! Search Web Services - YDN
Google: Web Search Examples - Google AJAX Search API - Google Code
Bing: Bing Developer Center

[yeto]

WingedPanther said:

It's possible, but has already been done. Dogpile.com, for example, does this. Any server-side language should work.

How does Dogpile do what they do and not get banned by Google?

Thanks,
yeto

[Alexander]

yeto said:

How does Dogpile do what they do and not get banned by Google?

Unless they say specifically, no one can know. Most likely they pay much money to allow high lookup rates with the search APIs.