无法从网页中获取某些表格数据的内容

Question

我已经编写了Python 3脚本，它使用硒从公鸡资源的IFrame中的表中提取数据。此表包含2018年MLB时间表。

但是，在执行脚本时，我收到以下错误：

selenium.common.exceptions.TimeoutException:

当它到达脚本中包含iframe的行时。为什么会这样？

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

driver = webdriver.Chrome()
driver.get("link above")
wait = WebDriverWait(driver, 10)
wait.until(EC.frame_to_be_available_and_switch_to_it(wait.until(EC.visibility_of_element_located((By.CSS_SELECTOR, "iframe#pageswitcher-content")))))
for items in wait.until(EC.presence_of_all_elements_located((By.CSS_SELECTOR, "table.waffle tr"))):
    data = [item.text for item in items.find_element_by_css_selector("td")]
    print(data)

driver.quit()

顺便说一句，如果你浏览上面的链接，你可以看到包含不同颜色徽标和文本的表格

仅供参考，我不希望在该iframe内恢复链接；相反，我想切换到它来获取数据。

Answer 1

该页面中有两个嵌套的iFrame用于访问内容。请尝试以下方法：

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

driver = webdriver.Chrome()
driver.get("above link")
wait = WebDriverWait(driver, 10)
wait.until(EC.frame_to_be_available_and_switch_to_it(wait.until(EC.visibility_of_element_located((By.CSS_SELECTOR, "iframe")))))
wait.until(EC.frame_to_be_available_and_switch_to_it(wait.until(EC.visibility_of_element_located((By.CSS_SELECTOR, "iframe#pageswitcher-content")))))
for items in wait.until(EC.presence_of_all_elements_located((By.CSS_SELECTOR, "table.waffle tr"))):
    data = [item.text for item in items.find_elements_by_css_selector("td")]
    print(data)

driver.quit()