java read a web page using url

Question

how to read next page of the same URL

the URL of the page contain many pages i read the first page using

URL(url).openStream()

but it just reading the first page

for example this site i read the first page how can i read the second culture.gov.uk/news/news_stories/6832.aspx

Dont ask duplicates of your own questions stackoverflow.com/questions/4438519/read-the-following-link, edit the first one and try to make it sensible — JoseK
– JoseK, Commented Dec 14, 2010 at 14:02
There is no such thing as the next page of an URL. An URL corresponds to one page. It could contain links to other pages, but that has nothing to do with the original URL. And there is no natural ordering, so it's impossible to tell which page is "next". — Sergei Tachenov
– Sergei Tachenov, Commented Dec 14, 2010 at 15:34
thanks for example this site i read the first page how can i read the second culture.gov.uk/news/news_stories/6832.aspx — asas
– asas, Commented Dec 14, 2010 at 15:53

Jigar Joshi · Accepted Answer · 2010-12-14 13:42:50Z

1

Next page will have some link.

You can parse HTML and collect all the links and then you can filter out which is the next link for this page and then read it same way.

Here is the example that will list all the links from given page. - using JSOUP

Note: It is certainly ill-legal to do this for some sites.

answered Dec 14, 2010 at 13:42

Jigar Joshi

241k42 gold badges409 silver badges446 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Bozho · Accepted Answer · 2010-12-14 13:42:35Z

0

You will need the URL scheme for paging. For example it can be url + "?page=" + page. It depends on the site. Note that scraping is not always legal.

answered Dec 14, 2010 at 13:42

Bozho

599k147 gold badges1.1k silver badges1.2k bronze badges

Collectives™ on Stack Overflow

java read a web page using url

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related