Support
Quality
Security
License
Reuse
Implements (some of) the Flickr API using jQuery.
Support
Quality
Security
License
Reuse
t
twitter-search-scraping-using-google-chromeby databigbang
JavaScript 
46 Version:Current
License: No License (No License)
License: No License (No License)Show how to scrape web sites which dynamically load data using a Google Chrome extension
Support
Quality
Security
License
Reuse
Extract oEmbed data from given webpage
Support
Quality
Security
License
Reuse
This project scrapes Wikipedia for its articles using BeautifulSoup to create a dataset and then draws analysis on the collected data.
Support
Quality
Security
License
Reuse
A data extraction tool for HousePricing(https://github.com/PENGZhaoqing/HousePricing)
Support
Quality
Security
License
Reuse
Example source code for the book "Web Scraping for Data Science with Python"
Support
Quality
Security
License
Reuse
Advanced news feeds extractor and finder library. Helps to automatically extract news from websites without RSS/ATOM feeds
Support
Quality
Security
License
Reuse
S
Scrapersby Police-Data-Accessibility-Project
Python 45 Version:Current License: Strong Copyleft (GPL-3.0)
Code relating to Scraping.
Support
Quality
Security
License
Reuse
R Tables for Regulatory Submissions Working Group
Support
Quality
Security
License
Reuse
A web scraper to convert GDToT links to Google Drive and direct download links
Support
Quality
Security
License
Reuse
High-performance asynchronous Douyin and TikTok unofficial API based on TikHub API.
Support
Quality
Security
License
Reuse
L
Linkedin-post-timestamp-extractorby Ollie-Boyd
JavaScript 45 Version:Current License: Strong Copyleft (GPL-3.0)
Given a Linkedin post URL we can decode the UTC timestamp which isn't otherwise available in frontend/API metadata.
Support
Quality
Security
License
Reuse
My CodeChef solutions
Support
Quality
Security
License
Reuse
Tracking PG&E outages
Support
Quality
Security
License
Reuse
Custom Maltego transforms
Support
Quality
Security
License
Reuse
Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
Support
Quality
Security
License
Reuse
NSFW reverse image search for reddit
Support
Quality
Security
License
Reuse
A nodejs Scraping Utility for lazy people. MIT Licensed
Support
Quality
Security
License
Reuse
A Node.js library to get a wide range of public Instagram data without API keys or logging in. https://www.npmjs.com/package/instapro
Support
Quality
Security
License
Reuse
Configurable and easy to use LinkedIn tool to automate connections with personalized messages.
Support
Quality
Security
License
Reuse
Java Selenide tool which scrapes fb group posts periodically and store them into database
Support
Quality
Security
License
Reuse
A python library for accessing your Edupage account
Support
Quality
Security
License
Reuse
🏠 a.k.a 591 rent scraper（591 租屋網爬蟲）
Support
Quality
Security
License
Reuse
Open Sports Data (sport.db) Web Site
Support
Quality
Security
License
Reuse
⭕️ Web Scraping in 60 Minutes
Support
Quality
Security
License
Reuse
s
scrape-nr-of-deaths-istanbulby nazliander
Jupyter Notebook 44 Version:Current License: No License (No License)
License: No License (No License)A scraper and simple time series analysis example with Selenium and Seaborn.
Support
Quality
Security
License
Reuse
Script to scrape data from Google Maps places.
Support
Quality
Security
License
Reuse
A scraper for EmulationStation
Support
Quality
Security
License
Reuse
Library for scraping websites or apis at any scale
Support
Quality
Security
License
Reuse
A Powerful Python script that downloads and checks proxies from several sites.
Support
Quality
Security
License
Reuse
Scrapes an arbitrary number of lines from a Discord channel
Support
Quality
Security
License
Reuse
scrape json from messy input streams
Support
Quality
Security
License
Reuse
Yasuri (鑢) is easy web scraping library.
Support
Quality
Security
License
Reuse
Google Books Downloader / Image Scraper
Support
Quality
Security
License
Reuse
Node.js based scraper using headless chrome
Support
Quality
Security
License
Reuse
Scrap ALL Bank Settlement from Indonesian iBanking account
Support
Quality
Security
License
Reuse
Scrape data from Google.com, Bing.com, Baidu.com, Ask.com, Yahoo.com, Yandex.com
Support
Quality
Security
License
Reuse
Scraper & GraphQL API untuk data Perguruan Tinggi di Indonesia berdasarkan dari website Kementrian RISTEKDIKTI.
Support
Quality
Security
License
Reuse
A Go scraper aimed at scrapping quotes.
Support
Quality
Security
License
Reuse
API for fetching data from news websites.
Support
Quality
Security
License
Reuse
Facebook Crawler - Crawl information from facebook
Support
Quality
Security
License
Reuse
A toolkit to build pythonic web scraper libraries
Support
Quality
Security
License
Reuse
Introduction to web scraping and text mining
Support
Quality
Security
License
Reuse
A web scraper php class using PHP cURL to scrap web page. By which you can scrap web page by cURL get, post methods also by which you can scrap web page content from a asp.net based websites with form post.
Support
Quality
Security
License
Reuse
Uber web interface crawler / scraper - Convert the trips table into a CSV file
Support
Quality
Security
License
Reuse
Scrapy integration with Tor for anonymous web scraping
Support
Quality
Security
License
Reuse
Yet Another LInkedIn Scraper...
Support
Quality
Security
License
Reuse
Support
Quality
Security
License
Reuse
Scrape comments, including their replies, from a YouTube video.
Support
Quality
Security
License
Reuse
i
image-downloaderby webscraperio
Python 46Updated: 4 y ago License: No License (No License)
46Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
j
jquery-flickrby rpheath
Implements (some of) the Flickr API using jQuery.
JavaScript 46Updated: 5 y ago License: No License (No License)
46Updated: 5 y ago License: No License (No License)Support
Quality
Security
License
Reuse
t
twitter-search-scraping-using-google-chromeby databigbang
Show how to scrape web sites which dynamically load data using a Google Chrome extension
JavaScript 46Updated: 5 y ago License: No License (No License)
46Updated: 5 y ago License: No License (No License)Support
Quality
Security
License
Reuse
o
oembed-parserby ndaidong
Extract oEmbed data from given webpage
JavaScript 46Updated: 3 y ago License: Permissive (MIT)
46Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
W
Web-Scraping-using-Pythonby kb22
This project scrapes Wikipedia for its articles using BeautifulSoup to create a dataset and then draws analysis on the collected data.
Jupyter Notebook 46Updated: 4 y ago License: Permissive (MIT)
46Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
s
scrapy-HousePricingby PENGZhaoqing
A data extraction tool for HousePricing(https://github.com/PENGZhaoqing/HousePricing)
Python 45Updated: 4 y ago License: No License (No License)
45Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
w
webscrapingfordatascienceby Macuyiko
Example source code for the book "Web Scraping for Data Science with Python"
Python 45Updated: 4 y ago License: No License (No License)
45Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
n
newsworkerby ivbeg
Advanced news feeds extractor and finder library. Helps to automatically extract news from websites without RSS/ATOM feeds
Python 45Updated: 4 y ago License: Permissive (MIT)
45Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
S
Scrapersby Police-Data-Accessibility-Project
Code relating to Scraping.
Python 45Updated: 4 y ago License: Strong Copyleft (GPL-3.0)
45Updated: 4 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
r
rtrs-wgby RConsortium
R Tables for Regulatory Submissions Working Group
HTML 45Updated: 2 y ago License: No License (No License)
45Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
g
gdtot-bypasserby viperadnan-git
A web scraper to convert GDToT links to Google Drive and direct download links
HTML 45Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
45Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
T
TikHub_API_PyPiby TikHubIO
High-performance asynchronous Douyin and TikTok unofficial API based on TikHub API.
Python 45Updated: 2 y ago License: Permissive (Apache-2.0)
45Updated: 2 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
L
Linkedin-post-timestamp-extractorby Ollie-Boyd
Given a Linkedin post URL we can decode the UTC timestamp which isn't otherwise available in frontend/API metadata.
JavaScript 45Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
45Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
c
codechefby charles-wangkai
My CodeChef solutions
Java 44Updated: 4 y ago License: No License (No License)
44Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
p
Support
Quality
Security
License
Reuse
m
Support
Quality
Security
License
Reuse
y
yellowpages-scraperby scrapehero
Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
Python 44Updated: 4 y ago License: No License (No License)
44Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
i
irarchivesby 4pr0n
NSFW reverse image search for reddit
Python 44Updated: 2 y ago License: No License (No License)
44Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
S
SUqby MattMcFarland
A nodejs Scraping Utility for lazy people. MIT Licensed
JavaScript 44Updated: 3 y ago License: Proprietary (Proprietary)
44Updated: 3 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
i
instaproby preethamvishy
A Node.js library to get a wide range of public Instagram data without API keys or logging in. https://www.npmjs.com/package/instapro
JavaScript 44Updated: 2 y ago License: Permissive (MIT)
44Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
l
linkedin_connectby mariiio
Configurable and easy to use LinkedIn tool to automate connections with personalized messages.
JavaScript 44Updated: 4 y ago License: Permissive (MIT)
44Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
f
facebook-group-scrape-toolby postullat
Java Selenide tool which scrapes fb group posts periodically and store them into database
Java 44Updated: 4 y ago License: No License (No License)
44Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
e
edupage-apiby ivanhrabcak
A python library for accessing your Edupage account
Python 44Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
44Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
f
fiveN1-rent-scraperby neighborhood999
🏠 a.k.a 591 rent scraper（591 租屋網爬蟲）
Go 44Updated: 4 y ago License: Permissive (MIT)
44Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
o
opensport.github.ioby opensport
Open Sports Data (sport.db) Web Site
CSS 44Updated: 4 y ago License: No License (No License)
44Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
W
WS60by maxhumber
⭕️ Web Scraping in 60 Minutes
Jupyter Notebook 44Updated: 2 y ago License: No License (No License)
44Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
s
scrape-nr-of-deaths-istanbulby nazliander
A scraper and simple time series analysis example with Selenium and Seaborn.
Jupyter Notebook 44Updated: 2 y ago License: No License (No License)
44Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
g
google_maps_scraperby patxijuaristi
Script to scrape data from Google Maps places.
Python 44Updated: 2 y ago License: No License (No License)
44Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
E
ES-scraperby elpendor
A scraper for EmulationStation
Python 43Updated: 5 y ago License: No License (No License)
43Updated: 5 y ago License: No License (No License)Support
Quality
Security
License
Reuse
s
scraperxby xtream1101
Library for scraping websites or apis at any scale
Python 43Updated: 4 y ago License: Permissive (MIT)
43Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
H
HiberProxyby All3xJ
A Powerful Python script that downloads and checks proxies from several sites.
Python 43Updated: 4 y ago License: No License (No License)
43Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
D
Discord-Channel-scraperby dolphinhats
Scrapes an arbitrary number of lines from a Discord channel
Python 43Updated: 2 y ago License: No License (No License)
43Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
j
json-scrapeby substack
scrape json from messy input streams
JavaScript 43Updated: 5 y ago License: Proprietary (Proprietary)
43Updated: 5 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
y
yasuriby tac0x2a
Yasuri (鑢) is easy web scraping library.
Ruby 43Updated: 4 y ago License: Permissive (MIT)
43Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
b
books-dlby spelufo
Google Books Downloader / Image Scraper
JavaScript 43Updated: 4 y ago License: No License (No License)
43Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
s
scraperby jonstuebe
Node.js based scraper using headless chrome
JavaScript 43Updated: 4 y ago License: Permissive (MIT)
43Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
m
mutasi-scraperby fdciabdul
Scrap ALL Bank Settlement from Indonesian iBanking account
JavaScript 43Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
43Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
S
SearchEngineScrapyby naqushab
Scrape data from Google.com, Bing.com, Baidu.com, Ask.com, Yahoo.com, Yandex.com
Python 42Updated: 4 y ago License: No License (No License)
42Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
k
kampus-scraperby sutanlab
Scraper & GraphQL API untuk data Perguruan Tinggi di Indonesia berdasarkan dari website Kementrian RISTEKDIKTI.
JavaScript 42Updated: 4 y ago License: Permissive (MIT)
42Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
g
goquotesby clouedoc
A Go scraper aimed at scrapping quotes.
Go 42Updated: 2 y ago License: No License (No License)
42Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
n
newsembleby rg089
API for fetching data from news websites.
Python 42Updated: 3 y ago License: No License (No License)
42Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
f
facebookcrawlerby jedivind
Facebook Crawler - Crawl information from facebook
Java 41Updated: 4 y ago License: No License (No License)
41Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
l
livescrapeby ondergetekende
A toolkit to build pythonic web scraper libraries
Python 41Updated: 5 y ago License: Permissive (MIT)
41Updated: 5 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
t
text-mining-classby ogrisel
Introduction to web scraping and text mining
Python 41Updated: 4 y ago License: Permissive (MIT)
41Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
w
web-scraperby tojibon
A web scraper php class using PHP cURL to scrap web page. By which you can scrap web page by cURL get, post methods also by which you can scrap web page content from a asp.net based websites with form post.
PHP 41Updated: 4 y ago License: No License (No License)
41Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
u
uber_databy Link-
Uber web interface crawler / scraper - Convert the trips table into a CSV file
HTML 41Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
41Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
s
scrapy-torby cvibhagool
Scrapy integration with Tor for anonymous web scraping
Python 40Updated: 5 y ago License: No License (No License)
40Updated: 5 y ago License: No License (No License)Support
Quality
Security
License
Reuse
l
Support
Quality
Security
License
Reuse
N
NewsScraperby holwech
Python 40Updated: 4 y ago License: No License (No License)
40Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
y
youtube-comments-taskby philbot9
Scrape comments, including their replies, from a YouTube video.
JavaScript 40Updated: 4 y ago License: Permissive (ISC)
40Updated: 4 y ago License: Permissive (ISC)Support
Quality
Security
License
Reuse