Repository navigation
crawl4ai
- Website
- Wikipedia
Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App
Transform Web Content into LLM-Ready Data
AI web scraper built with Crawl4AI for extracting structured leads data from websites.
Web crawling tool that integrates with AI assistants via the MCP
Integrates Supabase with Crawl4AI and AI Chat to create a powerful web crawling and semantic search solution. Streamlit supabase data visualization. Run all in Docker. API and more!
The Web Metadata Extraction Toolkit is designed to streamline the process of extracting, cleaning, and analyzing metadata from websites. Utilizing advanced AI models and custom extraction strategies, this toolkit helps users efficiently gather data like titles, descriptions, and keywords, which are crucial for SEO and content strategy.
Crawl4DeepSeek = Crawl4AI + DeepSeek 🚀 Smart, efficient, and built for deep web exploration! 🌐🤖
A feature-rich web application for automated news scraping and summarization. It allows users to enter article URLs, fetches the full content, and generates concise summaries. The system supports both local inference with custom models and remote deployment via FastAPI or Streamlit interfaces.
A tool for scraping web documentation using Crawl4AI, converting it to Markdown, and preparing it for integration with local LLMs (like Ollama) to enhance their knowledge for learning and "vibe coding" workflows.
Docker Compose to install N8N, Openweb UI, and other systems to create AI agents.
TypeScript implementation of an MCP server for Crawl4AI. Provides tools for web crawling, content extraction, and browser automation.
Puppeteer & Crawl4AI microservice for web automation, scraping, and AI processing with Bull queues
A web application that classifies reviews as real or fake by utilizng an NLP model (SVC classifier). It leverages crawl4ai for scraping reviews off of any product/service page, feeds it to the NLP model whose output gets displayed to the users.
Retrieval-Augmented Generation server with Pinecone and OpenAI
MCP server combining Qdrant vector search, Neo4j knowledge graphs, and Crawl4AI web intelligence with agentic RAG capabilities. FastMCP 2.0 architecture with enterprise security, monitoring, and Kubernetes deployment. AI/ML engineering powerhouse.
AI Scraper : scrap and extract data from website in any format (CSV, JSON, HTML...) using Selenium or Crawl4ai, and using Ollama or Sambanova API, and using Streamlit for UI as chatbot
Save manga as pdf
A friendly AI chatbot that shares the wisdom of Utkarsh Classes by default, while letting you effortlessly transform any website into your personalized Q&A learning hub