crawlab

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

An intelligent web service to automatically detect web content and extract information from it.

Documentation for Crawlab

Crawlab login automaticly.

Scrapy spiders for data collection