Support
Quality
Security
License
Reuse
Web scraper for scraping, tracking and visualizing prices of products on various websites.
Support
Quality
Security
License
Reuse
An open source Python library for scraping Historical Cryptocurrency data.
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!
Support
Quality
Security
License
Reuse
Golang scraper to get data from Google Play Store
Support
Quality
Security
License
Reuse
easy crawl web resource , extract web infomation/简单的爬虫框架
Support
Quality
Security
License
Reuse
Analyzes user's Instagram location geotags to find most frequent locations, countries, cities ...
Support
Quality
Security
License
Reuse
This module allows you to get the user data attached to a instagram account, by providing the profile's link.
Support
Quality
Security
License
Reuse
A library for scraping nearly every college bookstore in the US
Support
Quality
Security
License
Reuse
Extensible paste site scraper written in Golang.
Support
Quality
Security
License
Reuse
Juicer is a web API for extracting text, meta data and named entities from HTML "article" type pages.
Support
Quality
Security
License
Reuse
Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram
Support
Quality
Security
License
Reuse
Iota is a web scraper which can find all of the images and links/suburls on a webpage
Support
Quality
Security
License
Reuse
script to scrape direct download links (ddls) from google drive index.
Support
Quality
Security
License
Reuse
A super simple multithreaded proxy scraper; scraping & checking ~50k HTTP, HTTPS, SOCKS4, & SOCKS5 proxies.
Support
Quality
Security
License
Reuse
Quickly download and scrape websites on a massive scale.
Support
Quality
Security
License
Reuse
A Python Package which helps to scrape all news details from any news websites
Support
Quality
Security
License
Reuse
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
Support
Quality
Security
License
Reuse
s
scraping-helper-chrome-extensionby huangwc94
TypeScript 
58 Version:Current License: Permissive (MIT)
Scraping Helper will help you to find out the best html/css selector for certain elements
Support
Quality
Security
License
Reuse
Easily scrape and parse a table stored on a web page.
Support
Quality
Security
License
Reuse
Webtoons Scraper able to download all chapters of any series wanted.
Support
Quality
Security
License
Reuse
Web-scraping script that writes the data of all players from FutHead and FutBin to a CSV file or a DB
Support
Quality
Security
License
Reuse
A simple, easy to use framework for adding randomized, anonymous IP addresses and user-agents to web scrapers, crawlers, and penetration testing solutions
Support
Quality
Security
License
Reuse
Simple Python script to download music from SoundCloud, using API or HTML scrapping 🎧🐍
Support
Quality
Security
License
Reuse
Python script to scrape Kijiji and find new ads.
Support
Quality
Security
License
Reuse
A small app to programmatically mainpulate Barclays online banking
Support
Quality
Security
License
Reuse
Telegram Bot to scrap webpages using Requests, html5lib and Beautifulsoup
Support
Quality
Security
License
Reuse
Tool focused on extracting information from an account in different Social Networks / Herramienta enfocada a extraer información de una cuenta en diversas Redes Sociales, SIN usar nuestra Cuenta, NI API y SIN Límite. [NO ME HAGO RESPONSABLE DEL MAL USO DE ESTA HERRAMIENTA]
Support
Quality
Security
License
Reuse
Basic setup with random user agents and IP addresses for Python Scrapy Framework.
Support
Quality
Security
License
Reuse
A simple yet comprehensive web scraper for kenpom.com.
Support
Quality
Security
License
Reuse
A scraper for Impartus Lecture Capture videos for BITS Hyderabad
Support
Quality
Security
License
Reuse
Browserify-compatible module to get and set cookies in the browser
Support
Quality
Security
License
Reuse
Pluggable HTML Pipeline
Support
Quality
Security
License
Reuse
Demo app for website-scraper module
Support
Quality
Security
License
Reuse
Simple library which helps you to retrieve the source of various video streaming sites.
Support
Quality
Security
License
Reuse
Pahe.ph [Pahe.in] Movies Website Scraper
Support
Quality
Security
License
Reuse
w
web-scraping-with-pythonby rajat4665
Jupyter Notebook 56 Version:Current
License: No License (No License)
License: No License (No License)In this repository i will expalin how to scrap websites using python programming language with BeautifulSoup and requestsmodulues
Support
Quality
Security
License
Reuse
Tangerine Bank scraper
Support
Quality
Security
License
Reuse
Instagram comment scraper using python and selenium. Save the comments into excel.
Support
Quality
Security
License
Reuse
A Python 3 interface for working with Geocaching.com website.
Support
Quality
Security
License
Reuse
Scrapes an instagram user's photos and videos.
Support
Quality
Security
License
Reuse
Google Search SERP Scraper
Support
Quality
Security
License
Reuse
A JS package for scraping recipes from the web.
Support
Quality
Security
License
Reuse
Tiktok (Musically) PHP scraper
Support
Quality
Security
License
Reuse
A Scrapy middleware to bypass the CloudFlare's anti-bot protection
Support
Quality
Security
License
Reuse
Search for and retrieve US Patent and Trademark Office Patent Data
Support
Quality
Security
License
Reuse
A scraper fetching all company emails from Seedtable and Clutch websites.
Support
Quality
Security
License
Reuse
Access xvideos.com programmatically
Support
Quality
Security
License
Reuse
Web based UI to make scraping data from real estate websites super simple
Support
Quality
Security
License
Reuse
p
pitchfork-scraperby staylor
JavaScript 61Updated: 3 y ago License: No License (No License)
61Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
s
scraperby Crinibus
Web scraper for scraping, tracking and visualizing prices of products on various websites.
Python 61Updated: 2 y ago License: Permissive (MIT)
61Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
H
Historic_Cryptoby David-Woroniuk
An open source Python library for scraping Historical Cryptocurrency data.
Python 61Updated: 2 y ago License: Permissive (MIT)
61Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
s
stack-scraperby jeresig
HTML 61Updated: 4 y ago License: Permissive (MIT)
61Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
I
Instagram-downloaderby fernandod1
Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!
Python 61Updated: 2 y ago License: Proprietary (Proprietary)
61Updated: 2 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
g
google-play-scraperby n0madic
Golang scraper to get data from Google Play Store
Go 61Updated: 2 y ago License: Weak Copyleft (LGPL-3.0)
61Updated: 2 y ago License: Weak Copyleft (LGPL-3.0)Support
Quality
Security
License
Reuse
x
xspiderby intohole
easy crawl web resource , extract web infomation/简单的爬虫框架
Python 60Updated: 3 y ago License: No License (No License)
60Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
i
instagram-analyzerby nejckorasa
Analyzes user's Instagram location geotags to find most frequent locations, countries, cities ...
Python 60Updated: 2 y ago License: Permissive (Unlicense)
60Updated: 2 y ago License: Permissive (Unlicense)Support
Quality
Security
License
Reuse
u
user-instagramby EdouardCourty
This module allows you to get the user data attached to a instagram account, by providing the profile's link.
JavaScript 60Updated: 3 y ago License: No License (No License)
60Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
O
Open-Textbooksby bsgreenb
A library for scraping nearly every college bookstore in the US
PHP 60Updated: 4 y ago License: Permissive (MIT)
60Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
s
scrapeby averagesecurityguy
Extensible paste site scraper written in Golang.
Go 60Updated: 4 y ago License: No License (No License)
60Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
j
juicerby matth
Juicer is a web API for extracting text, meta data and named entities from HTML "article" type pages.
Scala 60Updated: 4 y ago License: Permissive (MIT)
60Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
i
instagoby siongui
Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram
Go 60Updated: 4 y ago License: Permissive (Unlicense)
60Updated: 4 y ago License: Permissive (Unlicense)Support
Quality
Security
License
Reuse
W
Web-Iotaby SatinWuker
Iota is a web scraper which can find all of the images and links/suburls on a webpage
Python 60Updated: 2 y ago License: No License (No License)
60Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
B
Bhadoo-Index-Scraperby sanjit-sinha
script to scrape direct download links (ddls) from google drive index.
Python 60Updated: 2 y ago License: No License (No License)
60Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
p
proXXyby Atropa-Solanaceae
A super simple multithreaded proxy scraper; scraping & checking ~50k HTTP, HTTPS, SOCKS4, & SOCKS5 proxies.
Python 60Updated: 1 y ago License: Permissive (MIT)
60Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
m
mass-scrapingby alexksikes
Quickly download and scrape websites on a massive scale.
Python 59Updated: 4 y ago License: Weak Copyleft (LGPL-3.0)
59Updated: 4 y ago License: Weak Copyleft (LGPL-3.0)Support
Quality
Security
License
Reuse
n
news-fetchby santhoshse7en
A Python Package which helps to scrape all news details from any news websites
Python 58Updated: 3 y ago License: Permissive (MIT)
58Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
l
logparserby my8100
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
Python 58Updated: 4 y ago License: Strong Copyleft (GPL-3.0)
58Updated: 4 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
s
scraping-helper-chrome-extensionby huangwc94
Scraping Helper will help you to find out the best html/css selector for certain elements
TypeScript 58Updated: 3 y ago License: Permissive (MIT)
58Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
H
HTML-Table-to-JSONby tremblay
Easily scrape and parse a table stored on a web page.
PHP 58Updated: 3 y ago License: Strong Copyleft (GPL-2.0)
58Updated: 3 y ago License: Strong Copyleft (GPL-2.0)Support
Quality
Security
License
Reuse
W
Webtoon-Downloaderby Zehina
Webtoons Scraper able to download all chapters of any series wanted.
Python 58Updated: 2 y ago License: Permissive (MIT)
58Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
f
fifa-FUT-Databy kafagy
Web-scraping script that writes the data of all players from FutHead and FutBin to a CSV file or a DB
Python 57Updated: 3 y ago License: Permissive (MIT)
57Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
s
slitherby kaelscion
A simple, easy to use framework for adding randomized, anonymous IP addresses and user-agents to web scrapers, crawlers, and penetration testing solutions
Python 57Updated: 4 y ago License: Permissive (MIT)
57Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
S
SoundCloudby yackx
Simple Python script to download music from SoundCloud, using API or HTML scrapping 🎧🐍
Python 57Updated: 4 y ago License: Strong Copyleft (GPL-3.0)
57Updated: 4 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
K
Kijiji-Scraperby CRutkowski
Python script to scrape Kijiji and find new ads.
Python 57Updated: 4 y ago License: Permissive (MIT)
57Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
b
barclayscrapeby russss
A small app to programmatically mainpulate Barclays online banking
JavaScript 57Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
57Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
W
WebScrapperby nuhmanpk
Telegram Bot to scrap webpages using Requests, html5lib and Beautifulsoup
Python 57Updated: 2 y ago License: Permissive (MIT)
57Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
N
NetSoc_OSINTby XDeadHackerX
Tool focused on extracting information from an account in different Social Networks / Herramienta enfocada a extraer información de una cuenta en diversas Redes Sociales, SIN usar nuestra Cuenta, NI API y SIN Límite. [NO ME HAGO RESPONSABLE DEL MAL USO DE ESTA HERRAMIENTA]
Shell 57Updated: 1 y ago License: Strong Copyleft (GPL-3.0)
57Updated: 1 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
P
PythonScrapyBasicSetupby matejbasic
Basic setup with random user agents and IP addresses for Python Scrapy Framework.
Python 56Updated: 4 y ago License: Permissive (MIT)
56Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
k
kenpompyby j-andrews7
A simple yet comprehensive web scraper for kenpom.com.
Python 56Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
56Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
i
ilc-scraperby iamkroot
A scraper for Impartus Lecture Capture videos for BITS Hyderabad
Python 56Updated: 3 y ago License: No License (No License)
56Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
c
cookie-cutterby substack
Browserify-compatible module to get and set cookies in the browser
JavaScript 56Updated: 3 y ago License: No License (No License)
56Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
h
html-pipeby Automattic
Pluggable HTML Pipeline
JavaScript 56Updated: 4 y ago License: No License (No License)
56Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
d
demoby website-scraper
Demo app for website-scraper module
JavaScript 56Updated: 3 y ago License: No License (No License)
56Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
S
SourceScraperby OpenByteDev
Simple library which helps you to retrieve the source of various video streaming sites.
TypeScript 56Updated: 4 y ago License: Permissive (MIT)
56Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
P
Pahe.ph-Scraperby roofman2008
Pahe.ph [Pahe.in] Movies Website Scraper
C# 56Updated: 2 y ago License: Permissive (MIT)
56Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
w
web-scraping-with-pythonby rajat4665
In this repository i will expalin how to scrap websites using python programming language with BeautifulSoup and requestsmodulues
Jupyter Notebook 56Updated: 1 y ago License: No License (No License)
56Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
t
tangerineby kevinjqiu
Tangerine Bank scraper
Python 55Updated: 3 y ago License: No License (No License)
55Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
I
Instagram-Comments-Scraperby AgiMaulana
Instagram comment scraper using python and selenium. Save the comments into excel.
Python 55Updated: 3 y ago License: Permissive (MIT)
55Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
p
pycachingby tomasbedrich
A Python 3 interface for working with Geocaching.com website.
Python 55Updated: 2 y ago License: Weak Copyleft (LGPL-3.0)
55Updated: 2 y ago License: Weak Copyleft (LGPL-3.0)Support
Quality
Security
License
Reuse
i
instagram-scraper-nodeby arc298
Scrapes an instagram user's photos and videos.
JavaScript 55Updated: 4 y ago License: Permissive (Unlicense)
55Updated: 4 y ago License: Permissive (Unlicense)Support
Quality
Security
License
Reuse
s
serpby christophebe
Google Search SERP Scraper
JavaScript 55Updated: 3 y ago License: No License (No License)
55Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
R
Recipe-Scraperby jadkins89
A JS package for scraping recipes from the web.
JavaScript 55Updated: 3 y ago License: Permissive (MIT)
55Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
t
tiktok-scraper-phpby snuzi
Tiktok (Musically) PHP scraper
PHP 55Updated: 3 y ago License: No License (No License)
55Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
s
scrapy-cloudflare-middlewareby clemfromspace
A Scrapy middleware to bypass the CloudFlare's anti-bot protection
Python 54Updated: 3 y ago License: Permissive (WTFPL)
54Updated: 3 y ago License: Permissive (WTFPL)Support
Quality
Security
License
Reuse
p
pypatentby daneads
Search for and retrieve US Patent and Trademark Office Patent Data
Python 54Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
54Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
c
company-email-scraperby FilipGrebowski
A scraper fetching all company emails from Seedtable and Clutch websites.
Python 54Updated: 3 y ago License: No License (No License)
54Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
x
xvideosby deoxxa
Access xvideos.com programmatically
JavaScript 54Updated: 4 y ago License: Proprietary (Proprietary)
54Updated: 4 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
p
property_web_scraperby RealEstateWebTools
Web based UI to make scraping data from real estate websites super simple
JavaScript 54Updated: 3 y ago License: Permissive (MIT)
54Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse