Get Instagram posts/profile/hashtag data without using Instagram API
Support
Quality
Security
License
Reuse
Scrape the Instagram frontend. Inspired from twitter-scraper by @kennethreitz.
Support
Quality
Security
License
Reuse
scrape data from the itunes app store
Support
Quality
Security
License
Reuse
Scrape content from OnlyFans and Fansly
Support
Quality
Security
License
Reuse
Preview extractor for news, articles and full-texts in Swift
Support
Quality
Security
License
Reuse
[Unmaintained] A simple and clean video/music/image downloader 👾
Support
Quality
Security
License
Reuse
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers, user info, images...
Support
Quality
Security
License
Reuse
Simple but useful Python web scraping tutorial code.
Support
Quality
Security
License
Reuse
p
panama-papers-dataset-2016by amaboura
Jupyter Notebook 
704 Version:Current License: Strong Copyleft (GPL-3.0)
Structured data about Panama papers collected from official ICIJ website
Support
Quality
Security
License
Reuse
🥫 The simple, fast, and modern web scraping library
Support
Quality
Security
License
Reuse
:scissors: High performance, multi-threaded image scraper
Support
Quality
Security
License
Reuse
Build Bots, Scrape a website or use an API to solve a problem.
Support
Quality
Security
License
Reuse
OnlyFans content downloader
Support
Quality
Security
License
Reuse
汇总多站点数据的AV元数据刮削器
Support
Quality
Security
License
Reuse
Universal Reddit Scraper - A comprehensive Reddit scraping/archival command-line tool.
Support
Quality
Security
License
Reuse
⛓ Extract web links information: title, description, images, videos, etc. [via OpenGraph], runs on mobiles and node.
Support
Quality
Security
License
Reuse
New Coder tutorials
Support
Quality
Security
License
Reuse
Free Web Scraping Tool with Java
Support
Quality
Security
License
Reuse
The web scraper that's nearly impossible to block - now called @ulixee/hero
Support
Quality
Security
License
Reuse
Extract structured data from web sites. Web sites scraping.
Support
Quality
Security
License
Reuse
Faster requests on Python 3
Support
Quality
Security
License
Reuse
Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.
Support
Quality
Security
License
Reuse
Scrapes the public profile of the linkedin page
Support
Quality
Security
License
Reuse
Google play scraper for Python inspired by <facundoolano/google-play-scraper>
Support
Quality
Security
License
Reuse
Fast high-level web crawling Ruby framework
Support
Quality
Security
License
Reuse
🎭 Playwright integration for Scrapy
Support
Quality
Security
License
Reuse
Web Content Retrieval for Humans™
Support
Quality
Security
License
Reuse
[not actively maintained] A lightweight Python library that uses Webkit to enable easy scraping of dynamic, Javascript-heavy web pages
Support
Quality
Security
License
Reuse
Easier web scraping using node.js and jQuery
Support
Quality
Security
License
Reuse
This Fansly downloader app is a must-have for Fansly enthusiasts. With this easy-to-use content downloading tool, you can download all your favorite content from fansly.com. No more manual downloads, enjoy your Fansly content offline anytime, anywhere! Fully customizable to download photos, videos, messages, collection & single posts 🔥
Support
Quality
Security
License
Reuse
Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.
Support
Quality
Security
License
Reuse
R Package for Scraping and Aggregating NFL Data
Support
Quality
Security
License
Reuse
Amazon Scraper. Scrape products from the amazon search result or reviews from the specific product
Support
Quality
Security
License
Reuse
Javascript scraping module based on puppeteer for many different search engines...
Support
Quality
Security
License
Reuse
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Support
Quality
Security
License
Reuse
w
web.scraper.workers.devby adamschwartz
JavaScript 471 Version:Current
License: No License (No License)
License: No License (No License)Scrape websites for text by CSS selector.
Support
Quality
Security
License
Reuse
LinkedIn Scraper (currently working 2020)
Support
Quality
Security
License
Reuse
p
python-automation-scriptsby avidLearnerInProgress
Python 464 Version:Current License: Strong Copyleft (GPL-3.0)
Simple yet powerful automation stuffs.
Support
Quality
Security
License
Reuse
Advanced python library to scrap Twitter (tweets, users) from unofficial API
Support
Quality
Security
License
Reuse
JAV影片信息刮削工具 保存信息至nfo 上传emby演员图片 115/aria2支持
Support
Quality
Security
License
Reuse
Readability / Html Content / Article Extractor & Web Scrapping library written in PHP
Support
Quality
Security
License
Reuse
A Manga download framework using selenium.
Support
Quality
Security
License
Reuse
A Node.js module to search and scrape Google.
Support
Quality
Security
License
Reuse
Instagram Scraper. Scrape useful data/posts from instagram users, hashtag and locations pages. Comments and people who liked specific posts and soon more. No login or API keys are required
Support
Quality
Security
License
Reuse
⛏️ Extract accounts info from personal pages on various sites for OSINT purpose
Support
Quality
Security
License
Reuse
Web scraping and HTML-reprocessing. The easy way.
Support
Quality
Security
License
Reuse
A set of spiders and scrapers to extract location information from places that post their location on the internet.
Support
Quality
Security
License
Reuse
p
predicting-car-price-from-scraped-databy nicolas-gervais
Jupyter Notebook 397 Version:Current License: No License (No License)
License: No License (No License)Picture and specifications scraper
Support
Quality
Security
License
Reuse
a
advanced-web-scraping-tutorialby sangaline
Python 390 Version:Current License: No License (No License)
License: No License (No License)The Zipru scraper developed in the Advanced Web Scraping Tutorial.
Support
Quality
Security
License
Reuse
🧶 Extract data from any website without code, just clicks.
Support
Quality
Security
License
Reuse
i
instagram-crawlerby huaying
Get Instagram posts/profile/hashtag data without using Instagram API
Python 945Updated: 11 mo ago License: Permissive (MIT)
945Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
i
instagram-scraperby meetmangukiya
Scrape the Instagram frontend. Inspired from twitter-scraper by @kennethreitz.
Python 924Updated: 1 y ago License: Permissive (MIT)
924Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
a
app-store-scraperby facundoolano
scrape data from the itunes app store
JavaScript 813Updated: 1 y ago License: Permissive (MIT)
813Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
U
UltimaScraperby DIGITALCRIMINALS
Scrape content from OnlyFans and Fansly
Python 805Updated: 10 mo ago License: Strong Copyleft (GPL-3.0)
805Updated: 10 mo ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
R
ReadabilityKitby exyte
Preview extractor for news, articles and full-texts in Swift
Swift 800Updated: 1 y ago License: Permissive (MIT)
800Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
L
Luluby iawia002
[Unmaintained] A simple and clean video/music/image downloader 👾
Python 793Updated: 3 y ago License: Permissive (MIT)
793Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
S
Scweetby Altimis
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers, user info, images...
Python 760Updated: 11 mo ago License: Permissive (MIT)
760Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
e
easy-scraping-tutorialby MorvanZhou
Simple but useful Python web scraping tutorial code.
Jupyter Notebook 709Updated: 1 y ago License: Permissive (MIT)
709Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
p
panama-papers-dataset-2016by amaboura
Structured data about Panama papers collected from official ICIJ website
Jupyter Notebook 704Updated: 3 y ago License: Strong Copyleft (GPL-3.0)
704Updated: 3 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
g
gazpachoby maxhumber
🥫 The simple, fast, and modern web scraping library
Python 703Updated: 1 y ago License: Permissive (MIT)
703Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
I
ImageScraperby sananth12
:scissors: High performance, multi-threaded image scraper
Python 645Updated: 3 y ago License: Strong Copyleft (GPL-3.0)
645Updated: 3 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
P
Python_and_the_Webby Python-World
Build Bots, Scrape a website or use an API to solve a problem.
Python 638Updated: 10 mo ago License: Permissive (MIT)
638Updated: 10 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
o
onlyfans-dlby k0rnh0li0
OnlyFans content downloader
Python 636Updated: 11 mo ago License: Strong Copyleft (GPL-3.0)
636Updated: 11 mo ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
J
Support
Quality
Security
License
Reuse
U
URSby JosephLai241
Universal Reddit Scraper - A comprehensive Reddit scraping/archival command-line tool.
Python 623Updated: 10 mo ago License: Permissive (MIT)
623Updated: 10 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
l
link-preview-jsby ospfranco
⛓ Extract web links information: title, description, images, videos, etc. [via OpenGraph], runs on mobiles and node.
TypeScript 617Updated: 1 y ago License: Permissive (MIT)
617Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
n
Support
Quality
Security
License
Reuse
n
newcrawlerby speed
Free Web Scraping Tool with Java
JavaScript 587Updated: 3 y ago License: No License (No License)
587Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
s
secret-agentby ulixee
The web scraper that's nearly impossible to block - now called @ulixee/hero
TypeScript 571Updated: 1 y ago License: Permissive (MIT)
571Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
d
dataflowkitby slotix
Extract structured data from web sites. Web sites scraping.
Go 571Updated: 1 y ago License: Permissive (BSD-3-Clause)
571Updated: 1 y ago License: Permissive (BSD-3-Clause)Support
Quality
Security
License
Reuse
f
faster-than-requestsby juancarlospaco
Faster requests on Python 3
Python 558Updated: 3 y ago License: Permissive (MIT)
558Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
l
lookylooby Lookyloo
Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.
Python 556Updated: 10 mo ago License: Proprietary (Proprietary)
556Updated: 10 mo ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
l
linkedin-scraperby yatish27
Scrapes the public profile of the linkedin page
Ruby 541Updated: 1 y ago License: Permissive (MIT)
541Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
g
google-play-scraperby JoMingyu
Google play scraper for Python inspired by <facundoolano/google-play-scraper>
Python 537Updated: 1 y ago License: Permissive (MIT)
537Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
v
vesselby rubycdp
Fast high-level web crawling Ruby framework
Ruby 536Updated: 11 mo ago License: Permissive (MIT)
536Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
s
scrapy-playwrightby scrapy-plugins
🎭 Playwright integration for Scrapy
Python 526Updated: 10 mo ago License: Permissive (BSD-3-Clause)
526Updated: 10 mo ago License: Permissive (BSD-3-Clause)Support
Quality
Security
License
Reuse
l
lassieby michaelhelmick
Web Content Retrieval for Humans™
HTML 525Updated: 3 y ago License: Permissive (MIT)
525Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
d
dryscrapeby niklasb
[not actively maintained] A lightweight Python library that uses Webkit to enable easy scraping of dynamic, Javascript-heavy web pages
Python 524Updated: 3 y ago License: Permissive (MIT)
524Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
n
node-scraperby mape
Easier web scraping using node.js and jQuery
JavaScript 515Updated: 3 y ago License: Permissive (MIT)
515Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
f
fanslyby Avnsx
This Fansly downloader app is a must-have for Fansly enthusiasts. With this easy-to-use content downloading tool, you can download all your favorite content from fansly.com. No more manual downloads, enjoy your Fansly content offline anytime, anywhere! Fully customizable to download photos, videos, messages, collection & single posts 🔥
Python 508Updated: 11 mo ago License: Strong Copyleft (GPL-3.0)
508Updated: 11 mo ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
l
link_thumbnailerby gottfrois
Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.
Ruby 496Updated: 3 y ago License: Permissive (MIT)
496Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
n
nflscrapRby maksimhorowitz
R Package for Scraping and Aggregating NFL Data
R 496Updated: 1 y ago License: No License (No License)
496Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
a
amazon-product-apiby drawrowfly
Amazon Scraper. Scrape products from the amazon search result or reviews from the specific product
JavaScript 484Updated: 11 mo ago License: No License (No License)
484Updated: 11 mo ago License: No License (No License)Support
Quality
Security
License
Reuse
s
se-scraperby NikolaiT
Javascript scraping module based on puppeteer for many different search engines...
HTML 479Updated: 2 y ago License: Permissive (Apache-2.0)
479Updated: 2 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
w
web-scrapingby je-suis-tm
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Python 476Updated: 11 mo ago License: Permissive (Apache-2.0)
476Updated: 11 mo ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
w
web.scraper.workers.devby adamschwartz
Scrape websites for text by CSS selector.
JavaScript 471Updated: 11 mo ago License: No License (No License)
471Updated: 11 mo ago License: No License (No License)Support
Quality
Security
License
Reuse
s
scrapedinby linkedtales
LinkedIn Scraper (currently working 2020)
JavaScript 465Updated: 3 y ago License: Permissive (Apache-2.0)
465Updated: 3 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
p
python-automation-scriptsby avidLearnerInProgress
Simple yet powerful automation stuffs.
Python 464Updated: 11 mo ago License: Strong Copyleft (GPL-3.0)
464Updated: 11 mo ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
s
stweetby markowanga
Advanced python library to scrap Twitter (tweets, users) from unofficial API
Python 453Updated: 10 mo ago License: Permissive (MIT)
453Updated: 10 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
J
JAVOneStopby ddd354
JAV影片信息刮削工具 保存信息至nfo 上传emby演员图片 115/aria2支持
Python 442Updated: 10 mo ago License: Permissive (MIT)
442Updated: 10 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
p
php-gooseby scotteh
Readability / Html Content / Article Extractor & Web Scrapping library written in PHP
PHP 438Updated: 1 y ago License: Permissive (Apache-2.0)
438Updated: 1 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
M
Manga_downloaderby xuzhengyi1995
A Manga download framework using selenium.
Python 437Updated: 10 mo ago License: No License (No License)
437Updated: 10 mo ago License: No License (No License)Support
Quality
Security
License
Reuse
n
node-googleby jprichardson
A Node.js module to search and scrape Google.
JavaScript 437Updated: 3 y ago License: Permissive (MIT)
437Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
i
instagram-scraperby drawrowfly
Instagram Scraper. Scrape useful data/posts from instagram users, hashtag and locations pages. Comments and people who liked specific posts and soon more. No login or API keys are required
TypeScript 433Updated: 10 mo ago License: No License (No License)
433Updated: 10 mo ago License: No License (No License)Support
Quality
Security
License
Reuse
s
socid-extractorby soxoj
⛏️ Extract accounts info from personal pages on various sites for OSINT purpose
Python 417Updated: 1 y ago License: Strong Copyleft (GPL-3.0)
417Updated: 1 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
i
ineedby inikulin
Web scraping and HTML-reprocessing. The easy way.
JavaScript 401Updated: 4 y ago License: Permissive (MIT)
401Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
a
alltheplacesby alltheplaces
A set of spiders and scrapers to extract location information from places that post their location on the internet.
Python 397Updated: 10 mo ago License: Proprietary (Proprietary)
397Updated: 10 mo ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
p
predicting-car-price-from-scraped-databy nicolas-gervais
Picture and specifications scraper
Jupyter Notebook 397Updated: 10 mo ago License: No License (No License)
397Updated: 10 mo ago License: No License (No License)Support
Quality
Security
License
Reuse
a
advanced-web-scraping-tutorialby sangaline
The Zipru scraper developed in the Advanced Web Scraping Tutorial.
Python 390Updated: 3 y ago License: No License (No License)
390Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
t
tinkingby baptisteArno
🧶 Extract data from any website without code, just clicks.
TypeScript 389Updated: 1 y ago License: Strong Copyleft (GPL-3.0)
389Updated: 1 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse