如何從android中的html鏈接獲取頁面的html源代碼？

Question

我正在研究一個需要從鏈接中獲取網頁源代碼的應用程序，然後解析該網頁中的html。

你能給我一些例子，或者從哪裏開始寫點什麼開始寫這樣的應用程序？

Answer 1

您可以使用HttpClient像這樣執行HTTP GET和檢索HTML響應，東西：

HttpClient client = new DefaultHttpClient(); 
HttpGet request = new HttpGet(url); 
HttpResponse response = client.execute(request); 

String html = ""; 
InputStream in = response.getEntity().getContent(); 
BufferedReader reader = new BufferedReader(new InputStreamReader(in)); 
StringBuilder str = new StringBuilder(); 
String line = null; 
while((line = reader.readLine()) != null) 
{ 
    str.append(line); 
} 
in.close(); 
html = str.toString(); 

Answer 2

如果你看看here或here，你會看到，你不能這樣做，直接與Android API，你需要一個外部librairy ...

您可以在這裏2之間選擇的上文，如果你需要一個外部的圖書館。

Answer 3

public class RetrieveSiteData extends AsyncTask<String, Void, String> { 
@Override 
protected String doInBackground(String... urls) { 
    StringBuilder builder = new StringBuilder(100000); 

    for (String url : urls) { 
     DefaultHttpClient client = new DefaultHttpClient(); 
     HttpGet httpGet = new HttpGet(url); 
     try { 
      HttpResponse execute = client.execute(httpGet); 
      InputStream content = execute.getEntity().getContent(); 

      BufferedReader buffer = new BufferedReader(new InputStreamReader(content)); 
      String s = ""; 
      while ((s = buffer.readLine()) != null) { 
       builder.append(s); 
      } 

     } catch (Exception e) { 
      e.printStackTrace(); 
     } 
    } 

    return builder.toString(); 
} 

@Override 
protected void onPostExecute(String result) { 

} 
} 

Answer 4

我建議jsoup。

根據他們的網站：

獲取維基百科網頁，它解析爲DOM，並從在新聞欄目中選擇標題爲元素（在線樣本）的列表：

Document doc = Jsoup.connect("http://en.wikipedia.org/").get(); 
Elements newsHeadlines = doc.select("#mp-itn b a"); 

入門：

1. Download的jsoup罐子核心庫
2. 閱讀cookbook介紹
3. 享受！

玩得開心， 保羅

Answer 5

這樣稱呼它

new RetrieveFeedTask(new OnTaskFinished() 
     { 
      @Override 
      public void onFeedRetrieved(String feeds) 
      { 
       //do whatever you want to do with the feeds 
      } 
     }).execute("http://enterurlhere.com"); 

RetrieveFeedTask.class

class RetrieveFeedTask extends AsyncTask<String, Void, String> 
{ 
    String HTML_response= ""; 

    OnTaskFinished onOurTaskFinished; 


    public RetrieveFeedTask(OnTaskFinished onTaskFinished) 
    { 
     onOurTaskFinished = onTaskFinished; 
    } 
    @Override 
    protected void onPreExecute() 
    { 
     super.onPreExecute(); 
    } 

    @Override 
    protected String doInBackground(String... urls) 
    { 
     try 
     { 
      URL url = new URL(urls[0]); // enter your url here which to download 

      URLConnection conn = url.openConnection(); 

      // open the stream and put it into BufferedReader 
      BufferedReader br = new BufferedReader(new InputStreamReader(conn.getInputStream())); 

      String inputLine; 

      while ((inputLine = br.readLine()) != null) 
      { 
       // System.out.println(inputLine); 
       HTML_response += inputLine; 
      } 
      br.close(); 

      System.out.println("Done"); 

     } 
     catch (MalformedURLException e) 
     { 
      e.printStackTrace(); 
     } 
     catch (IOException e) 
     { 
      e.printStackTrace(); 
     } 
     return HTML_response; 
    } 

    @Override 
    protected void onPostExecute(String feed) 
    { 
     onOurTaskFinished.onFeedRetrieved(feed); 
    } 
} 

OnTaskFinished.java

public interface OnTaskFinished 
{ 
    public void onFeedRetrieved(String feeds); 
} 

Answer 6

這個問題有點舊，但我想我現在應該發佈我的答案，現在DefaultHttpClient,HttpGet等已被棄用。給定一個URL，這個函數應該得到並返回HTML。

public static String getHtml(String url) throws IOException { 
    // Build and set timeout values for the request. 
    URLConnection connection = (new URL(url)).openConnection(); 
    connection.setConnectTimeout(5000); 
    connection.setReadTimeout(5000); 
    connection.connect(); 

    // Read and store the result line by line then return the entire string. 
    InputStream in = connection.getInputStream(); 
    BufferedReader reader = new BufferedReader(new InputStreamReader(in)); 
    StringBuilder html = new StringBuilder(); 
    for (String line; (line = reader.readLine()) != null;) { 
     html.append(line); 
    } 
    in.close(); 

    return html.toString(); 
}