Java-HTML客户端在完成页面加载之前返回响应

Question

我必须从网页上阅读某一领域的内容。我已经被告知，我需要获得整个页面，然后从html内容中提取文本。我正在使用下面的程序来获取所需的页面html内容。现在的问题是，这个网页加载我想要读取的实际文本值需要几秒钟的时间，即使前面加载了其余的静态页面组件。我的程序在静态组件加载之后但在我的值加载之前返回html内容。因此，我得到的最终HTML有页面加载过程pic，而不是实际值。有没有人可以指导我在这个程序中所需的更改，以帮助它等到页面完全加载？

HttpPost post = new HttpPost("https://..../login");

    //prepare get method
    HttpGet httpget = new HttpGet("https://...../value#/123");

    // add parameters to the post method
    List<NameValuePair> parameters = new ArrayList<NameValuePair>();
    parameters.add(new BasicNameValuePair("username", "<name>"));
    parameters.add(new BasicNameValuePair("password", "<password>"));
    try {
        UrlEncodedFormEntity sendEntity = new UrlEncodedFormEntity(parameters, HTTP.DEF_CONTENT_CHARSET);
        post.setEntity(sendEntity);

        // create the client and execute the post method
        HttpClient client = HttpClientBuilder.create().build();

        HttpResponse postResponse = client.execute(post);
        System.out.println("Statusline: " + postResponse.getStatusLine());


        //Output the Response from the POST
        System.out.println(getStringFromInputStream(postResponse.getEntity().getContent()));

        //releasing POST
        EntityUtils.consume(postResponse.getEntity());

        //Execute get
        HttpContext context = new BasicHttpContext();

        HttpResponse getResponse = client.execute(httpget);//, context);
        System.out.println("Statusline: " + getResponse.getStatusLine());

        if (getResponse.getStatusLine().getStatusCode() != HttpStatus.SC_OK)
            throw new IOException(getResponse.getStatusLine().toString());

        System.out.print(getStringFromInputStream(getResponse.getEntity().getContent()));

Answer 1

您也可以使用Jsoup库访问http://Jsoup.org