Repository navigation
web-scraper
- Website
- Wikipedia
The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data 🔥
⚡ Easiest no code web data extraction platform • Instantly turn any website into API or spreadsheet ⚡
🕷️ An undetectable, powerful, flexible, high-performance Python library to make Web Scraping Easy and Effortless as it should be!
A collection of awesome web crawler,spider in different languages
Self-hosted webscraper.
A list of practical knowledge-building projects.
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
Web Scraper in Go, similar to BeautifulSoup
Generate and download e-books from online sources.
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
🚀 Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
Bulk download your favourite anime episodes from your favourite anime websites
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
OnlyFans content downloader
A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.