Repository navigation

#

scrapper

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

Python
779
3 年前

Advanced python library to scrap Twitter (tweets, users) from unofficial API

Python
603
2 年前

Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.

Python
596
1 年前

scrape proxies from more than 5 different sources and check which ones are still alive

Python
555
8 个月前

🧶 Extract data from any website without code, just clicks.

TypeScript
421
4 年前

Scrape emails, phone numbers and social media accounts from a website.

Python
266
2 年前
JavaScript
224
9 个月前

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Python
184
2 个月前

Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!

Python
180
4 年前

Scrape Algorithm Questions from leetcode and generate html and epub file

Python
156
1 年前

This script scrapes the HTML from different web pages to get the information from the video (XVideos, PornHub, RedTube) and you can use it in your own video player.

PHP
146
1 年前

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

Python
127
6 年前

Golang pkg to quickly return a preview of a webpage (title/description/images)

Go
111
2 年前

Source code of tiktok video downloader without watermark based on telegram

Python
98
5 个月前

A complete nodejs API to extract streaming sites video direct URLs

JavaScript
88
2 年前

Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.

Python
78
9 个月前