1. Grabs All Hyperlinks

原文地址：http://www.mkyong.com/java/jsoup-html-parser-hello-world-examples/

,a HTML parser,its “jquery-like” and “regex” selector syntax is very easy to use and flexible enough to get whatever you want. Below are three examples to show you how to use Jsoup to get links,images,page title and “div” element content from a HTML page.

Download jsoupThe jsoup is available in Maven central repository. For non-Maven user,just download it from.

This example shows you how to use jsoup to get page’s title and grabs all links from “google.com”.

import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;

import java.io.IOException;

public class HTMLParserExample1 {

<span class="token keyword"&gt;public <span class="token keyword"&gt;static <span class="token keyword"&gt;void <span class="token function"&gt;main<span class="token punctuation"&gt;(String<span class="token punctuation"&gt;[<span class="token punctuation"&gt;] args<span class="token punctuation"&gt;) <span class="token punctuation"&gt;{

    Document doc<span class="token punctuation"&gt;;
    <span class="token keyword"&gt;try <span class="token punctuation"&gt;{

        <span class="token comment"&gt;// need http protocol
        doc <span class="token operator"&gt;= Jsoup<span class="token punctuation"&gt;.<span class="token function"&gt;connect<span class="token punctuation"&gt;(<span class="token string"&gt;"http://google.com"<span class="token punctuation"&gt;)<span class="token punctuation"&gt;.<span class="token function"&gt;get<span class="token punctuation"&gt;(<span class="token punctuation"&gt;)<span class="token punctuation"&gt;;

        <span class="token comment"&gt;// get page title
        String title <span class="token operator"&gt;= doc<span class="token punctuation"&gt;.<span class="token function"&gt;title<span class="token punctuation"&gt;(<span class="token punctuation"&gt;)<span class="token punctuation"&gt;;
        System<span class="token punctuation"&gt;.out<span class="token punctuation"&gt;.<span class="token function"&gt;println<span class="token punctuation"&gt;(<span class="token string"&gt;"title : " <span class="token operator"&gt;+ title<span class="token punctuation"&gt;)<span class="token punctuation"&gt;;

        <span class="token comment"&gt;// get all links
        Elements links <span class="token operator"&gt;= doc<span class="token punctuation"&gt;.<span class="token function"&gt;select<span class="token punctuation"&gt;(<span class="token string"&gt;"a[href]"<span class="token punctuation"&gt;)<span class="token punctuation"&gt;;
        <span class="token keyword"&gt;for <span class="token punctuation"&gt;(Element link <span class="token operator"&gt;: links<span class="token punctuation"&gt;) <span class="token punctuation"&gt;{

            <span class="token comment"&gt;// get the value from href attribute
            System<span class="token punctuation"&gt;.out<span class="token punctuation"&gt;.<span class="token function"&gt;println<span class="token punctuation"&gt;(<span class="token string"&gt;"\nlink : " <span class="token operator"&gt;+ link<span class="token punctuation"&gt;.<span class="token function"&gt;attr<span class="token punctuation"&gt;(<span class="token string"&gt;"href"<span class="token punctuation"&gt;)<span class="token punctuation"&gt;)<span class="token punctuation"&gt;;
            System<span class="token punctuation"&gt;.out<span class="token punctuation"&gt;.<span class="token function"&gt;println<span class="token punctuation"&gt;(<span class="token string"&gt;"text : " <span class="token operator"&gt;+ link<span class="token punctuation"&gt;.<span class="token function"&gt;text<span class="token punctuation"&gt;(<span class="token punctuation"&gt;)<span class="token punctuation"&gt;)<span class="token punctuation"&gt;;

        <span class="token punctuation"&gt;}

    <span class="token punctuation"&gt;} <span class="token keyword"&gt;catch <span class="token punctuation"&gt;(<span class="token class-name"&gt;IOException e<span class="token punctuation"&gt;) <span class="token punctuation"&gt;{
        e<span class="token punctuation"&gt;.<span class="token function"&gt;printStackTrace<span class="token punctuation"&gt;(<span class="token punctuation"&gt;)<span class="token punctuation"&gt;;
    <span class="token punctuation"&gt;}

<span class="token punctuation"&gt;}

}

Output

link : http://www.google.com.my/imghp?hl=en&amp;tab=wi

text : Images
link : http://maps.google.com.my/maps?hl=en&amp;tab=wl

text : Maps
//omitted for readability

NoteIt’s recommended to specify a “userAgent” in Jsoup,to avoid HTTP 403 error messages.

<pre class=" language-java"><code class=" language-java">Document doc = Jsoup.connect("http://anyurl.com")
.userAgent("Mozilla")
.get();

2. Grabs All Images

The second example shows you how to use the Jsoup regex selector to grab all image files (png,jpg,gif) from “yahoo.com”.

import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;

import java.io.IOException;

热点

1. Grabs All Hyperlinks