distributed-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

Simple but useful Python web scraping tutorial code.

Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner

Distributed Scraper

Peer 2 peer distributed/serverless computing solution.Define the problem , the way workers to solve it, code dependencies. Then the most difficult part is to find more workers/peers.. Example usecase : distributed web scraper

基于Scrapy的分布式爬虫，用于抓取诗词