網頁抓取

用於網站爬取、無頭瀏覽和資料提取的框架與工具。

Repositories

Scrapy, a fast high-level web crawling & scraping framework for Python.

Python

60.5k

Elegant Scraper and Crawler Framework for Golang

25.1k

Puppeteer 是一個 JavaScript 函式庫，提供高階 API 透過 DevTools 協定或 WebDriver BiDi 控制 Chrome 或 Firefox。預設以無頭模式執行，廣泛用於網頁爬蟲、測試與自動化任務。

TypeScript

93.7k

The fast, flexible, and elegant library for parsing and manipulating HTML and XML.

TypeScript

30.1k

🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN

Python

61.1k

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频｜评论爬虫、微博帖子｜评论爬虫、百度贴吧帖子｜百度贴吧评论回复爬虫 | 知乎问答文章｜评论爬虫

Python

44.8k

⬛️ CLI tool and library for saving complete web pages as a single HTML file

Rust

14.8k