0
我使用下面的代碼獲取google搜索結果的前兩頁 但我只能抓取第一頁(當搜索頁面2時,它與第1頁)如何使用htmlunit在Google上獲取「下一頁」
import com.gargoylesoftware.htmlunit.WebClient;
import com.gargoylesoftware.htmlunit.html.HtmlElement;
import com.gargoylesoftware.htmlunit.html.HtmlPage;
import com.gargoylesoftware.htmlunit.html.HtmlTextInput;
/**
* A simple Google search test using HtmlUnit.
*
* @author Rahul Poonekar
* @since Apr 18, 2010
*/
public class Author_search {
static final WebClient browser;
static {
browser = new WebClient();
browser.setJavaScriptEnabled(false);
}
public static void main(String[] arguments) {
searchTest();
}
private static void searchTest() {
HtmlPage currentPage = null;
try {
currentPage = (HtmlPage) browser.getPage("http://www.google.com");
} catch (Exception e) {
System.out.println("Could not open browser window");
e.printStackTrace();
}
System.out.println("Simulated browser opened.");
try {
((HtmlTextInput) currentPage.getElementByName("q")).setValueAttribute("xxoo");
currentPage = currentPage.getElementByName("btnG").click();
System.out.println("contents: " + currentPage.asText());
HtmlElement next = (HtmlElement)currentPage.getByXPath("//span[contains(text(), 'Next')]").get(0);
currentPage = next.click();
System.out.println("contents: " + currentPage.asText());
} catch (Exception e) {
System.out.println("Could not search");
e.printStackTrace();
}
}
}
有人可以告訴我如何解決這個問題嗎?
的方式:
- 如何使用改變的HtmlUnit在谷歌的語言設置?任何 方便的方法?
- 是否治療的HtmlUnit像「螢火蟲」的HTML中 Firefox中,或者只是把它當作在文本「文件 - >保存」。在我 的意見,我相信它像對待這是一個探險家,我說的對?
需要進口:com.gargoylesoftware.htmlunit.html.HtmlAnchor – 2012-02-29 00:03:55