P
PDAP-Scrapersby Police-Data-Accessibility-Project
Python 
147 Version:Current License: Strong Copyleft (GPL-3.0)
Code relating to scraping public police data.
Support
Quality
Security
License
Reuse
Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Support
Quality
Security
License
Reuse
Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Support
Quality
Security
License
Reuse
Zillow Scraper for Python using Selenium
Support
Quality
Security
License
Reuse
OSINT tool to scrape names and usernames from large friend lists on Facebook, without being rate limited.
Support
Quality
Security
License
Reuse
Search Google News and easily download the results to a CSV.
Support
Quality
Security
License
Reuse
京东自动登录，在线商品自动下单
Support
Quality
Security
License
Reuse
Web-Scraping for Humans!
Support
Quality
Security
License
Reuse
Scrape emails, phone numbers and social media accounts from a website.
Support
Quality
Security
License
Reuse
An open database of persons of interest and politically exposed persons
Support
Quality
Security
License
Reuse
A Python library for extracting titles, images, descriptions and canonical urls from HTML.
Support
Quality
Security
License
Reuse
Python library to download bulk of images from Bing.com
Support
Quality
Security
License
Reuse
The most integrated web scraper package for Laravel.
Support
Quality
Security
License
Reuse
Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel
Support
Quality
Security
License
Reuse
Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.
Support
Quality
Security
License
Reuse
MetaData html scraper and parser for Node.js (supports Promises and callback style)
Support
Quality
Security
License
Reuse
Spotify scraper
Support
Quality
Security
License
Reuse
scrape google search results
Support
Quality
Security
License
Reuse
ralger makes it easy to scrape a website. Built on the shoulders of titans: rvest, xml2.
Support
Quality
Security
License
Reuse
Python's package to scrap Twitter's front-end easily
Support
Quality
Security
License
Reuse
A test suite of common scraper detection techniques. See how detectable your scraper stack is.
Support
Quality
Security
License
Reuse
Get Aliexpress product details as a json response including feedbacks, variants, description, images, etc.,
Support
Quality
Security
License
Reuse
Scrapes g4g and creates PDF
Support
Quality
Security
License
Reuse
Code for the second edition Web Scraping with Python book by Packt Publications
Support
Quality
Security
License
Reuse
a
auto-Instagram-posting-botby HenryAlbu
Python 125 Version:Current License: Strong Copyleft (GPL-3.0)
A bot that downloads 9gag and Instagram posts, and re-uploads it to your Instagram account
Support
Quality
Security
License
Reuse
simple metadata scrapper for node.js
Support
Quality
Security
License
Reuse
📖 Collect links to profiles by username through search engines and analyze with various plugins
Support
Quality
Security
License
Reuse
Scrapes images from a list of urls with wget
Support
Quality
Security
License
Reuse
🔎 A simple metadata scrapper for node.js.
Support
Quality
Security
License
Reuse
A python package for scraping oddsportal.com
Support
Quality
Security
License
Reuse
Node npm for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, an array with all the links, all the images in it, etc. Inspired by the metainspector Ruby gem
Support
Quality
Security
License
Reuse
w
web-scraper-chrome-extensionby ispras
JavaScript 123 Version:Current License: Weak Copyleft (LGPL-3.0)
Web data extraction tool implemented as chrome extension
Support
Quality
Security
License
Reuse
Scraping, parsing and indexing the daily Congressional Record to support phrase search over time, and by legislator and date
Support
Quality
Security
License
Reuse
Python Package for scraping NHL Play-by-Play and Shift data
Support
Quality
Security
License
Reuse
w
website-scraper-puppeteerby website-scraper
JavaScript 121 Version:Current License: Permissive (MIT)
Plugin for website-scraper which returns html for dynamic websites using puppeteer
Support
Quality
Security
License
Reuse
Go cascadia package command line CSS selector
Support
Quality
Security
License
Reuse
DMM 影片内容刮削器
Support
Quality
Security
License
Reuse
Scrape web data at scale completely and accurately.
Support
Quality
Security
License
Reuse
Scrapping data from Real Estate site www.idealista.com
Support
Quality
Security
License
Reuse
Scrapes facebook's pages front end with no limitations & provides a feature to turn data into structured JSON or CSV
Support
Quality
Security
License
Reuse
e
election_2016_databy Prooffreader
Jupyter Notebook 120 Version:Current
License: No License (No License)
License: No License (No License)Scraped data from the 2016 U.S. Election (President, Senate, House, Governor) and primaries, ballot measures and exit polls
Support
Quality
Security
License
Reuse
Serverless IMDB API powered by Cloudflare Worker
Support
Quality
Security
License
Reuse
I
Instagram-Bot-Scrape-DM-Usersby pythontester192
Python 120 Version:Current License: No License (No License)
License: No License (No License)This Python Bot Scrape Instagram User Followers & Send DM to the Scraped Users with Account Switcher Feature.
Support
Quality
Security
License
Reuse
Here is all the code from my videos
Support
Quality
Security
License
Reuse
A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
A simple tiktok video downloader written in go
Support
Quality
Security
License
Reuse
estela, an elastic web scraping cluster 🕸
Support
Quality
Security
License
Reuse
Zehef is an osint tool to track emails
Support
Quality
Security
License
Reuse
Web Scraping with Beautiful Soup and Selenium
Support
Quality
Security
License
Reuse
P
PDAP-Scrapersby Police-Data-Accessibility-Project
Code relating to scraping public police data.
Python 147Updated: 12 mo ago License: Strong Copyleft (GPL-3.0)
147Updated: 12 mo ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
s
sqrapeby cathalgarvey
Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Go 145Updated: 3 y ago License: Strong Copyleft (AGPL-3.0)
145Updated: 3 y ago License: Strong Copyleft (AGPL-3.0)Support
Quality
Security
License
Reuse
U
UdemyCourseGrabberby keethesh
Your will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Python 144Updated: 3 y ago License: Permissive (MIT)
144Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
Z
Zillowby ChrisMuir
Zillow Scraper for Python using Selenium
Python 143Updated: 3 y ago License: No License (No License)
143Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
f
fb_friend_list_scraperby n0kovo
OSINT tool to scrape names and usernames from large friend lists on Facebook, without being rate limited.
Python 142Updated: 1 y ago License: Strong Copyleft (GPL-3.0)
142Updated: 1 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
N
NewsDownloaderby JustinWi
Search Google News and easily download the results to a CSV.
JavaScript 141Updated: 4 y ago License: No License (No License)
141Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
g
Support
Quality
Security
License
Reuse
l
Support
Quality
Security
License
Reuse
T
TheScrapperby champmq
Scrape emails, phone numbers and social media accounts from a website.
Python 138Updated: 12 mo ago License: Strong Copyleft (GPL-3.0)
138Updated: 12 mo ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
o
opensanctionsby alephdata
An open database of persons of interest and politically exposed persons
Python 137Updated: 4 y ago License: Permissive (MIT)
137Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
e
extractionby lethain
A Python library for extracting titles, images, descriptions and canonical urls from HTML.
Python 137Updated: 3 y ago License: Permissive (MIT)
137Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
b
bing_image_downloaderby gurugaurav
Python library to download bulk of images from Bing.com
Python 137Updated: 11 mo ago License: Permissive (MIT)
137Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
l
laravel-scavengerby reliqarts
The most integrated web scraper package for Laravel.
PHP 136Updated: 1 y ago License: Permissive (MIT)
136Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
e
ebayMarketAnalyzerby driscoll42
Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel
Python 136Updated: 1 y ago License: No License (No License)
136Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
a
actor-page-analyzerby apify
Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.
JavaScript 135Updated: 1 y ago License: No License (No License)
135Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
h
html-metadataby wikimedia
MetaData html scraper and parser for Node.js (supports Promises and callback style)
JavaScript 135Updated: 1 y ago License: Permissive (MIT)
135Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
S
SpotiFileby Michael-K-Stein
Spotify scraper
Python 133Updated: 1 y ago License: No License (No License)
133Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
g
google-searchby rocketlaunchr
scrape google search results
Go 130Updated: 11 mo ago License: Permissive (MIT)
130Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
r
ralgerby feddelegrand7
ralger makes it easy to scrape a website. Built on the shoulders of titans: rvest, xml2.
R 130Updated: 3 y ago License: Proprietary (Proprietary)
130Updated: 3 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
t
twitter-scraper-seleniumby shaikhsajid1111
Python's package to scrap Twitter's front-end easily
Python 130Updated: 1 y ago License: Permissive (MIT)
130Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
d
double-agentby unblocked-web
A test suite of common scraper detection techniques. See how detectable your scraper stack is.
TypeScript 130Updated: 1 y ago License: Permissive (MIT)
130Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
a
aliexpress-product-scraperby sudheer-ranga
Get Aliexpress product details as a json response including feedbacks, variants, description, images, etc.,
JavaScript 129Updated: 1 y ago License: Permissive (MIT)
129Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
G
GeeksForGeeksScrapperby CuriousLearner
Scrapes g4g and creates PDF
Python 128Updated: 3 y ago License: Permissive (MIT)
128Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
w
wswpby kjam
Code for the second edition Web Scraping with Python book by Packt Publications
Python 127Updated: 1 y ago License: No License (No License)
127Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
a
auto-Instagram-posting-botby HenryAlbu
A bot that downloads 9gag and Instagram posts, and re-uploads it to your Instagram account
Python 125Updated: 1 y ago License: Strong Copyleft (GPL-3.0)
125Updated: 1 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
m
meta-fetcherby rocktimsaikia
simple metadata scrapper for node.js
TypeScript 125Updated: 3 y ago License: No License (No License)
125Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
m
marpleby soxoj
📖 Collect links to profiles by username through search engines and analyze with various plugins
Python 125Updated: 1 y ago License: Permissive (MIT)
125Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
w
wget-image-scraperby eduardschaeli
Scrapes images from a list of urls with wget
Shell 124Updated: 3 y ago License: No License (No License)
124Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
m
meta-fetcherby RocktimSaikia
🔎 A simple metadata scrapper for node.js.
TypeScript 124Updated: 3 y ago License: Permissive (MIT)
124Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
s
scrapeOPby Seb943
A python package for scraping oddsportal.com
Python 123Updated: 1 y ago License: No License (No License)
123Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
n
node-metainspectorby gabceb
Node npm for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, an array with all the links, all the images in it, etc. Inspired by the metainspector Ruby gem
JavaScript 123Updated: 4 y ago License: Permissive (MIT)
123Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
w
web-scraper-chrome-extensionby ispras
Web data extraction tool implemented as chrome extension
JavaScript 123Updated: 1 y ago License: Weak Copyleft (LGPL-3.0)
123Updated: 1 y ago License: Weak Copyleft (LGPL-3.0)Support
Quality
Security
License
Reuse
C
Capitol-Wordsby propublica
Scraping, parsing and indexing the daily Congressional Record to support phrase search over time, and by legislator and date
Python 121Updated: 2 y ago License: Permissive (BSD-3-Clause)
121Updated: 2 y ago License: Permissive (BSD-3-Clause)Support
Quality
Security
License
Reuse
H
Hockey-Scraperby HarryShomer
Python Package for scraping NHL Play-by-Play and Shift data
Python 121Updated: 1 y ago License: Strong Copyleft (GPL-3.0)
121Updated: 1 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
w
website-scraper-puppeteerby website-scraper
Plugin for website-scraper which returns html for dynamic websites using puppeteer
JavaScript 121Updated: 3 y ago License: Permissive (MIT)
121Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
c
cascadiaby suntong
Go cascadia package command line CSS selector
Go 121Updated: 1 y ago License: Permissive (MIT)
121Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
d
Support
Quality
Security
License
Reuse
p
pulsarMSby platonai
Scrape web data at scale completely and accurately.
Kotlin 121Updated: 2 y ago License: Strong Copyleft (AGPL-3.0)
121Updated: 2 y ago License: Strong Copyleft (AGPL-3.0)Support
Quality
Security
License
Reuse
S
Scrapy-Idealistaby David-Carrasco
Scrapping data from Real Estate site www.idealista.com
Python 120Updated: 12 mo ago License: Strong Copyleft (GPL-2.0)
120Updated: 12 mo ago License: Strong Copyleft (GPL-2.0)Support
Quality
Security
License
Reuse
f
facebook_page_scraperby shaikhsajid1111
Scrapes facebook's pages front end with no limitations & provides a feature to turn data into structured JSON or CSV
Python 120Updated: 11 mo ago License: Permissive (MIT)
120Updated: 11 mo ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
e
election_2016_databy Prooffreader
Scraped data from the 2016 U.S. Election (President, Senate, House, Governor) and primaries, ballot measures and exit polls
Jupyter Notebook 120Updated: 3 y ago License: No License (No License)
120Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
i
imdb-apiby tuhinpal
Serverless IMDB API powered by Cloudflare Worker
JavaScript 120Updated: 1 y ago License: Permissive (Apache-2.0)
120Updated: 1 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
I
Instagram-Bot-Scrape-DM-Usersby pythontester192
This Python Bot Scrape Instagram User Followers & Send DM to the Scraped Users with Account Switcher Feature.
Python 120Updated: 1 y ago License: No License (No License)
120Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
J
JavaTutorialCodeby alexlorenlee
Here is all the code from my videos
Java 117Updated: 1 y ago License: No License (No License)
117Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
i
instagram-python-scraperby luengwaiban
A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!
Python 116Updated: 3 y ago License: Permissive (MIT)
116Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
t
trackback_scraperby Genius
Ruby 116Updated: 3 y ago License: No License (No License)
116Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
t
tiktok-dlby pikami
A simple tiktok video downloader written in go
Go 116Updated: 3 y ago License: Permissive (MIT)
116Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
e
estelaby bitmakerla
estela, an elastic web scraping cluster 🕸
TypeScript 115Updated: 1 y ago License: Permissive (MIT)
115Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
Z
Zehefby N0rz3
Zehef is an osint tool to track emails
Python 115Updated: 11 mo ago License: Strong Copyleft (GPL-3.0)
115Updated: 11 mo ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
W
Web-Scrapingby VincentTatan
Web Scraping with Beautiful Soup and Selenium
Python 112Updated: 1 y ago License: No License (No License)
112Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse