无法使用Python Beautiful Soup刮取特定网站

Question

我一直试图用BS刮这个网页，但没有用。有人能帮帮我吗？我不确定这个网页有什么问题，或者我的代码有什么问题。

from urllib.request import urlopen as uReq
from bs4 import BeautifulSoup

my_url = "https://www.cea.gov.sg/Custom/CEA/PublicRegister/Page/PublicRegisterDetail.aspx?UserId=ae0cdf1d-a30c-4c8c-9f80-b2cec17b4bd9"

uClient = uReq(my_url)
page_html = uClient.read()
uClient.close()
page_soup = Soup(page_html, "html.parser")
nameList2 = page_soup.findAll("span")

print (nameList2.string[1])

Answer 1

你可以这样试试。我没有发现任何问题。

import requests
from bs4 import BeautifulSoup

response = requests.get("https://www.cea.gov.sg/Custom/CEA/PublicRegister/Page/PublicRegisterDetail.aspx?UserId=ae0cdf1d-a30c-4c8c-9f80-b2cec17b4bd9")
soup = BeautifulSoup(response.text,"html.parser")
for item in soup.select(".form-wrap"):
    Name = item.select_one("#FtPublicRegisterDetail_LblName").get_text()
    Agent_Name = item.select_one("#FtPublicRegisterDetail_LblEstAgentName").get_text()
    print(Name, Agent_Name)

结果：

A R N MADANAGOPALAN (MADAN) PROPNEX REALTY PTE LTD

如果您愿意，请仅使用“span”：

import requests
from bs4 import BeautifulSoup

response = requests.get("https://www.cea.gov.sg/Custom/CEA/PublicRegister/Page/PublicRegisterDetail.aspx?UserId=ae0cdf1d-a30c-4c8c-9f80-b2cec17b4bd9")
soup = BeautifulSoup(response.text,"html.parser")

doc_list = soup.select("span")

for item in range(len(doc_list)):
    names = soup.select("span")[item].text
    print(names)

结果：

A R N MADANAGOPALAN (MADAN)
R016176H
01 Jan 2013 to 31 Dec 2017
NA
NA
NA
PROPNEX REALTY PTE LTD