Thread: url input stream returning blank

hi all,

i'm trying to extract a particular website into a html text file but i've tried many ways and so far i'm getting a blank website. i can open the website normally on a browser and its source code is viewable within the browser, but when i do a inputstream on it, i get nothing but nulls.

it's basically a linkbee redirection website e.g. http:// linkbee.com/FTHNN. i realize it's a redirection website but i should still be able to extract the html code of this website. the redirection occurs only after clicking a button, there's no timer, and i don't require actually following the redirection, i simply need to the url that it redirects to. in this case it can be found in line 81 input type='hidden' id='urlholder' value='http://www.megaupload.com/?d=VBS1H7ZK'.

my source code is -

	URL u = new URL(str);
	URLConnection uconn = u.openConnection();
	uconn.connect();
	InputStream is = uconn.getInputStream();
	br3 = new BufferedReader(new InputStreamReader(is));
	while(true)   br3.readLine();

it works for every website i've tried on but this.

thanks for any help

it works for every website i've tried on but this.

Which website is "this"??
What do you read from that website?

When i tried reading from http:// linkbee.com/FTHNN (space after //) I get 1 byte of 0xFF.

Sometimes websites require a user agent or it will return unexpected results. Try setting it with something like the following

URLConnection conn = url.openConnection();
conn.setRequestProperty("User-Agent", "Mozilla/4.0 (compatible; MSIE 4.01; Windows NT)");

There is usually a reason for a server to be configured in such a way. As a result I'd recommend checking to be sure you are not violating any policies in doing so.

Btw, the default User-Agent when using Java URL.openConnection() is Java/version

Oh and setting the user agent as suggested by copeg works just dandy for the above mentioned url.

// Json