如何从刮擦的URL列表中下载图像？[重复]

Question

可能重复：
如何使用请求下载图像

我有这个Python脚本用于抓取tumblr博客的图像URL，并希望将它们下载到我桌面上的本地文件夹中。我将如何着手实施这一点

import requests 
from bs4 import BeautifulSoup 

def make_soup(url):
#downloads a page with requests and creates a beautifulsoup object

    raw_page = requests.get(url).text
    soup = BeautifulSoup(raw_page)

    return soup


def get_images(soup):
#pulls images from the current page

    images = []

    foundimages = soup.find_all('img')

    for image in foundimages:
        url = img['src']

        if 'media.tumblr.com' in url:
            images.append(url)


    return images


def scrape_blog(url):
# scrapes the entire blog

    soup = make_soup(url)

    next_page = soup.find('a' id = 'nextpage')

    while next_page is not none:

        soup = make_soup(url + next_page['href'])
        next_page = soup.find('a' id = 'nextpage')

        more_images = get_images(soup)
        images.extend(more_images)

    return images


url = 'http://x.tumblr.com'
images = scrape_blog(url)

Answer 1

Python的“urllib2”可能就是您想要的。如果您需要做任何复杂的事情（比如cookie或身份验证），那么可能值得研究一个包装器库，比如请求，它为标准库中许多更麻烦的特性提供了一个很好的包装器。