I'm having the same kind of problem: I want to fetch data from web pages that require JavaScript to be enabled on the browser. When my program fetches the URL, the webpage says "This page requires scripting to be enabled", whereas the same URL in my Firefox shows the web page with the prices and everything.
So my question: is there a way to enable scripting for a program (something with InputStream and OutputStream ) (I'm writing in Java by the way). It is likely that there isn't, to avoid denial-of-service hacking, and in this case, is there a way to make Java interact with Firefox so that Firefox fetches the page and retrieves it to the Java program?
This project really means a lot to me, so thanks for any advice (even if I have to change my programming language)
miguel
|