当前位置: 首页 > 文档资料 > Scrapy 中文文档 >

Python 模块索引

优质
小牛编辑
127浏览
2023-12-01

s

 
s
scrapy
   
scrapy.contracts
   
scrapy.contracts.default
   
scrapy.contrib.closespider
Close spider extension
   
scrapy.contrib.corestats
Core stats collection
   
scrapy.contrib.debug
Extensions for debugging Scrapy
   
scrapy.contrib.downloadermiddleware
   
scrapy.contrib.downloadermiddleware.ajaxcrawl
   
scrapy.contrib.downloadermiddleware.chunked
Chunked Transfer Middleware
   
scrapy.contrib.downloadermiddleware.cookies
Cookies Downloader Middleware
   
scrapy.contrib.downloadermiddleware.defaultheaders
Default Headers Downloader Middleware
   
scrapy.contrib.downloadermiddleware.downloadtimeout
Download timeout middleware
   
scrapy.contrib.downloadermiddleware.httpauth
HTTP Auth downloader middleware
   
scrapy.contrib.downloadermiddleware.httpcache
HTTP Cache downloader middleware
   
scrapy.contrib.downloadermiddleware.httpcompression
Http Compression Middleware
   
scrapy.contrib.downloadermiddleware.httpproxy
Http Proxy Middleware
   
scrapy.contrib.downloadermiddleware.redirect
Redirection Middleware
   
scrapy.contrib.downloadermiddleware.retry
Retry Middleware
   
scrapy.contrib.downloadermiddleware.robotstxt
robots.txt middleware
   
scrapy.contrib.downloadermiddleware.stats
Downloader Stats Middleware
   
scrapy.contrib.downloadermiddleware.useragent
User Agent Middleware
   
scrapy.contrib.exporter
Item Exporters
   
scrapy.contrib.linkextractors
Link extractors classes
   
scrapy.contrib.linkextractors.lxmlhtml
lxml's HTMLParser-based link extractors
   
scrapy.contrib.loader
Item Loader class
   
scrapy.contrib.loader.processor
A collection of processors to use with Item Loaders
   
scrapy.contrib.logstats
记录基本统计(stats)
   
scrapy.contrib.memdebug
Memory debugger extension
   
scrapy.contrib.memusage
Memory usage extension
   
scrapy.contrib.pipeline.images
Images Pipeline
   
scrapy.contrib.spidermiddleware
   
scrapy.contrib.spidermiddleware.depth
Depth Spider Middleware
   
scrapy.contrib.spidermiddleware.httperror
HTTP Error Spider Middleware
   
scrapy.contrib.spidermiddleware.offsite
Offsite Spider Middleware
   
scrapy.contrib.spidermiddleware.referer
Referer Spider Middleware
   
scrapy.contrib.spidermiddleware.urllength
URL Length Spider Middleware
   
scrapy.contrib.spiders
Collection of generic spiders
   
scrapy.contrib.statsmailer
StatsMailer extension
   
scrapy.crawler
The Scrapy crawler
   
scrapy.exceptions
Scrapy exceptions
   
scrapy.http
Request and Response classes
   
scrapy.item
Item and Field classes
   
scrapy.log
Logging facility
   
scrapy.mail
Email sending facility
   
scrapy.selector
Selector class
   
scrapy.settings
Settings manager
   
scrapy.signalmanager
The signal manager
   
scrapy.signals
Signals definitions
   
scrapy.spider
Spiders base class, spider manager and spider middleware
   
scrapy.spidermanager
The spider manager
   
scrapy.statscol
Stats Collectors
   
scrapy.telnet
The Telnet Console
   
scrapy.utils.trackref
Track references of live objects