爬虫学习资料

PHP

QueryList|优雅的渐进式PHP采集框架

Python

Scrapyd

Scrapyd — Scrapyd 1.2.0 documentation

my8100/scrapydweb: Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO (github.com)

各种语言实现的爬虫

BruceDone/awesome-crawler: A collection of awesome web crawler,spider in different languages (github.com)