XPath枚举元素时硒色驱动异常

Question

我正在尝试将一个硒脚本从火狐转换为Chrome。该代码在x86_64上与火狐和壁虎驱动程序一起工作。壁虎驱动程序不支持ARM，所以我试图转移到Chrome。

Chrome和chromedriver在使用驱动程序时导致异常。通过xpath（'/*[@id]'）查找元素。。例外是selenium。常见的例外。WebDriverException:消息：无法访问chrome。

问题是什么，我如何解决它？

这是测试程序。

$ cat test.py
#!/usr/bin/env python3

import sys
import selenium

from packaging import version
from selenium import webdriver
#from selenium.webdriver.firefox.options import Options
from selenium.webdriver.chrome.options import Options

def main():

    #################################################

    if version.parse(selenium.__version__) >= version.parse("3.0"):
        opts = Options()
        opts.headless = True
        opts.binary_location = "/usr/bin/chromium"

        #driver = webdriver.Firefox(options=opts)
        driver = webdriver.Chrome(chrome_options=opts)
        driver.maximize_window()
    else:
        #profile = webdriver.FirefoxProfile()
        profile = webdriver.ChromeProfile()
        profile.headless = True
        profile.binary_location = "/usr/bin/chromium"

        #driver = webdriver.Firefox(profile)
        driver = webdriver.Chrome(profile)
        driver.maximize_window()

    agent = driver.execute_script('return navigator.userAgent')
    print(agent)

    #################################################

    driver.get("https://complaints.donotcall.gov/complaint/complaintcheck.aspx")
    driver.implicitly_wait(3)

    ids = driver.find_elements_by_xpath('//*[@id]')
    for ii in ids:
        print(ii.get_attribute('id'))

    #################################################

    driver.quit()

if __name__ == "__main__":
    main()

以下是尝试使用Chrome和chrome驱动程序枚举X路径时的异常。

$ ./test.py

Mozilla/5.0 (X11; Linux armv7l) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/72.0.3626.122 Safari/537.36
Traceback (most recent call last):
  File "./test.py", line 50, in <module>
    main()
  File "./test.py", line 41, in main
    ids = driver.find_elements_by_xpath('//*[@id]')
  File "/usr/local/lib/python3.5/dist-packages/selenium/webdriver/remote/webdriver.py", line 410, in find_elements_by_xpath
    return self.find_elements(by=By.XPATH, value=xpath)
  File "/usr/local/lib/python3.5/dist-packages/selenium/webdriver/remote/webdriver.py", line 1007, in find_elements
    'value': value})['value'] or []
  File "/usr/local/lib/python3.5/dist-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "/usr/local/lib/python3.5/dist-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: chrome not reachable
  (Session info: headless chrome=72.0.3626.122)
  (Driver info: chromedriver=72.0.3626.122,platform=Linux 4.4.132+ armv7l)

此代码：

ids = driver.find_elements_by_xpath('//*[@id]')
for val in ids:
    print(val.get_attribute('id'))

应该返回如下内容：

Head1
_fed_an_ua_tag
bdyComplaint
top
changeLang
topnav
navbtn
mobileChangeLang
Form1
__EVENTTARGET
__EVENTARGUMENT
__VIEWSTATE
__VIEWSTATEGENERATOR
__EVENTVALIDATION
StepOnePanel
StepOneEntryPanel
ErrorMsg
PhoneTextBox
DateOfCallTextBox
TimeOfCallDropDownList
ddlMinutes
PrerecordMessageYESRadioButton
PrerecordMessageNORadioButton
PhoneCallRadioButton
MobileTextMessageRadioButton
ddlSubjectMatter
spnTxtSubjectMatter
txtSubjectMatter
StepOneContinueButton
hdnBlockBack
hdnPhoneChecked
hdnCompanyChecked
hdnPhoneNumber

以下是版本号。

tinkerboard$ python3 --version
Python 3.5.3
tinkerboard$ /usr/bin/chromium --version
Chromium 72.0.3626.122 built on Debian 9.8, running on Debian 9.8
tinkerboard$ /usr/bin/chromedriver --version
ChromeDriver 72.0.3626.122

Answer 1

问题似乎是，Chrome浏览器的名称是不同操作系统和平台上的移动目标。这段代码避免了x86_64和LinuxARM上的异常：

def get_chrome():
    """
    Helper function to locate chrome browser.
    """
    if os.path.isfile('/usr/bin/chromium-browser'):
        return '/usr/bin/chromium-browser'
    if os.path.isfile('/usr/bin/chromium'):
        return '/usr/bin/chromium'
    if os.path.isfile('/usr/bin/chrome'):
        return '/usr/bin/chrome'
    if os.path.isfile('/usr/bin/google-chrome'):
        return '/usr/bin/google-chrome'

    return None

然后像这样使用它：

if version.parse(selenium.__version__) >= version.parse("3.0"):
    opts = Options()
    opts.binary_location = get_chrome()
    opts.add_argument('--headless')
    opts.add_argument('--no-sandbox')
    opts.add_argument('--disable-dev-shm-usage')

    driver = webdriver.Chrome(chrome_options=opts)
    driver.maximize_window()
else:
    profile = webdriver.ChromeProfile()
    profile.headless = True
    profile.binary_location = get_chrome()

    driver = webdriver.Chrome(profile)
    driver.maximize_window()