硒（Python）在抓取数据时卡住

Question

我试图抓取亚马逊的一些产品，但是当程序抓取的时候卡住了。这是代码:

from selenium import webdriver
import time
import pandas as pd
import openpyxl
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.by import By

options = webdriver.ChromeOptions()
options.add_argument('--start-maximized')

driver = webdriver.Chrome(r'C:\chromedriver.exe', options = options)
driver.get("https://www.amazon.es/")

buscador = driver.find_element_by_xpath('/html/body/div[1]/header/div/div[1]/div[2]/div/form/div[3]/div[1]/input')
buscador.send_keys('Tarjetas gráficas', Keys.RETURN) # Searches 'Tarjetas gráficas' (graphic cards) on Amazon

btn_cookies = driver.find_element_by_xpath('/html/body/div[1]/span/form/div[2]/span[1]/span').click() # Accept cookies

lista_nombres = [] # List of product's names
lista_precios = [] # List of product's prices
n = 0

for j in range(7):
    n += 1
    s = 0
    time.sleep(1)

    try: # This try-except is because when the program doesn't find more items it sends an error, then it should stop scraping.
        while True:
            try:
                driver.get('https://www.amazon.es/s?k=Tarjetas+gráficas&page={}'.format(n))
                WebDriverWait(driver, 10).until(EC.presence_of_all_elements_located((By.XPATH, '//*[@id="search"]/div[1]/div/div[1]/div/span[3]/div[2]/div[' + str(s) + ']/div/span/div/div/div/div/div[2]/h2/a')))
                btn_articulo = driver.find_element_by_xpath('//*[@id="search"]/div[1]/div/div[1]/div/span[3]/div[2]/div[' + str(s) + ']/div/span/div/div/div/div/div[2]/h2/a').click()
                WebDriverWait(driver, 10).until(EC.presence_of_element_located((By.ID, 'productTitle')))
                nombre = driver.find_element_by_id('productTitle')
                WebDriverWait(driver, 10).until(EC.presence_of_element_located((By.ID, 'priceblock_ourprice')))
                precio = driver.find_element_by_id('priceblock_ourprice')
                driver.get('https://www.amazon.es/s?k=Tarjetas+gráficas&page={}'.format(n))
                WebDriverWait(driver, 10).until(EC.presence_of_all_elements_located((By.CLASS_NAME, 'a-size-base-plus.a-color-base.a-text-normal')))

                lista_nombres.append(nombre)
                lista_precios.append(precio)
                print(len(lista_nombres)) # I print de length of the two lists to see if the program is scraping the data
                print(len(lista_precios))
                s += 1
            except:
                s += 1
                driver.get('https://www.amazon.es/s?k=Tarjetas+gráficas&page={}'.format(n))
                driver.set_page_load_timeout(10) 
    except:
        print('Finished')



df = pd.DataFrame({'Nombre':lista_nombres, 'Precio':lista_precios})
print(df)

df.to_excel('Tarjetas gráficas Amazon.xlsx', index = False)

time.sleep(5)
driver.close()

这是输出：

1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
12
12

正如你所看到的，当它到达产品编号12时，它卡在那里，但是，它没有发送任何错误信息或任何东西。我不知道该怎么办，我需要帮助。谢了。

Answer 1

我认为你应该重新考虑使用而True，你也应该记住，除了在块之外尝试会捕获所有错误，从而无法退出