webscraping

The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data 🔥

Create agents that monitor and act on your behalf. Your agents are standing by!

LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.

Easiest no code web data extraction platform. Instantly turn any website into API or spreadsheet.

A cli tool to browse and play anime

List of libraries, tools and APIs for web scraping and data processing.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

🕷️ An undetectable, powerful, flexible, high-performance Python library to make Web Scraping Easy and Effortless as it should be!

Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️‍♂️ when scraping the web?

Self-hosted webscraper.

🦊 Anti-detect browser

Scrapoxy is a super proxies manager that orchestrates all your proxies into one place, rather than spreading management across multiple scrapers. It manages IP rotation and fingerprinting, and smartly routes traffic to avoid bans.

Web Scraper in Go, similar to BeautifulSoup

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

Vision utilities for web interaction agents 👀

The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

Persistent HTTP cache for python requests

👻 Experimental library for scraping websites using OpenAI's GPT API.

LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping

Undetected version of the Playwright testing and automation library.