Java--HTML客户端在完成页面加载之前返回响应

Question

我必须从网页上阅读某个领域的内容。有人告诉我，我需要获取整个页面，然后从html内容中提取文本。我使用以下程序来获取所需的页面html内容。现在的问题是，这个网页需要几秒钟的时间来加载我想要读取的实际文本值，即使其他静态页面组件都是在前面加载的。我的程序在静态组件加载之后，但在我的值加载之前，返回html内容。因此，我得到的最终HTML具有页面加载过程pic，而不是实际值。有没有人可以指导我在这个程序中所需的更改，这将有助于它等到页面完全加载？

HttpPost post = new HttpPost("https://..../login");

    //prepare get method
    HttpGet httpget = new HttpGet("https://...../value#/123");

    // add parameters to the post method
    List<NameValuePair> parameters = new ArrayList<NameValuePair>();
    parameters.add(new BasicNameValuePair("username", "<name>"));
    parameters.add(new BasicNameValuePair("password", "<password>"));
    try {
        UrlEncodedFormEntity sendEntity = new UrlEncodedFormEntity(parameters, HTTP.DEF_CONTENT_CHARSET);
        post.setEntity(sendEntity);

        // create the client and execute the post method
        HttpClient client = HttpClientBuilder.create().build();

        HttpResponse postResponse = client.execute(post);
        System.out.println("Statusline: " + postResponse.getStatusLine());


        //Output the Response from the POST
        System.out.println(getStringFromInputStream(postResponse.getEntity().getContent()));

        //releasing POST
        EntityUtils.consume(postResponse.getEntity());

        //Execute get
        HttpContext context = new BasicHttpContext();

        HttpResponse getResponse = client.execute(httpget);//, context);
        System.out.println("Statusline: " + getResponse.getStatusLine());

        if (getResponse.getStatusLine().getStatusCode() != HttpStatus.SC_OK)
            throw new IOException(getResponse.getStatusLine().toString());

        System.out.print(getStringFromInputStream(getResponse.getEntity().getContent()));

Answer 1

您还可以使用JSoup库访问http://jsoup.org