Scrape google search results
Support
Quality
Security
License
Reuse
📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.
Support
Quality
Security
License
Reuse
library to access the internet banking area of "Deutsche Kreditbank" to get account information and transactions
Support
Quality
Security
License
Reuse
Yet another multi language scraper for Amazon targeting reviews.
Support
Quality
Security
License
Reuse
A library use jQuery like API for html parsing & node selecting & node mutation, suitable for web scraping and html confusion.
Support
Quality
Security
License
Reuse
Scrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!
Support
Quality
Security
License
Reuse
A Lightweight Weather Scraper
Support
Quality
Security
License
Reuse
A powerful scraper for JavaScript Developers.
Support
Quality
Security
License
Reuse
PHP IMDb Scraping API
Support
Quality
Security
License
Reuse
A LinkedIn Scraper to scrape up to 10k LinkedIn profiles from company profile links and save their e-mail addresses if available!
Support
Quality
Security
License
Reuse
Python Package for Instagram Users, Posts, and Hashtag data.
Support
Quality
Security
License
Reuse
Search engine scraper tool with BASH script.
Support
Quality
Security
License
Reuse
Fetches information about every webpage 🤖
Support
Quality
Security
License
Reuse
Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.
Support
Quality
Security
License
Reuse
Find your Facebook Friends Ranking Score http://arjunsreedharan.org/post/65979958297/find-your-facebook-friends-ranking-score
Support
Quality
Security
License
Reuse
Google search scraper with captcha solving support
Support
Quality
Security
License
Reuse
Bet365.com soccer scraper
Support
Quality
Security
License
Reuse
Extract data from TikTok without needing any login information or API keys.
Support
Quality
Security
License
Reuse
Extract domains/subdomains from URLs en masse
Support
Quality
Security
License
Reuse
Data extraction of Google's COVID-19 Mobility Reports
Support
Quality
Security
License
Reuse
Free to use and not for sale. This repo uses scrape or data.json
Support
Quality
Security
License
Reuse
Backup your friends' Instagram Stories forever and get to keep them even after 24 hours.
Support
Quality
Security
License
Reuse
P
Python-Web-Scraping-Second-Editionby PacktPublishing
Python 
80 Version:Current
License: No License (No License)
License: No License (No License)Python Web Scraping Second Edition, published by Packt
Support
Quality
Security
License
Reuse
PHP Library for detecting CMS
Support
Quality
Security
License
Reuse
All my public C64 stuff
Support
Quality
Security
License
Reuse
A test suite of common scraper detection techniques. See how detectable your scraper stack is.
Support
Quality
Security
License
Reuse
Sports odds and results scraping for Odds Portal (oddsportal.com).
Support
Quality
Security
License
Reuse
s
script.module.openscrapersby a4k-openproject
Python 79 Version:Current License: Strong Copyleft (GPL-3.0)
OpenScrapers Project
Support
Quality
Security
License
Reuse
Simple Flickr Image Scraper
Support
Quality
Security
License
Reuse
Command line utility for scraping YouTube comments.
Support
Quality
Security
License
Reuse
An API to easily get data from the University of Pittsburgh
Support
Quality
Security
License
Reuse
A script to scrap housing listings sites
Support
Quality
Security
License
Reuse
Python API to extract data from rateyourmusic.com.
Support
Quality
Security
License
Reuse
📷 Save your Instagram photos to your own website!
Support
Quality
Security
License
Reuse
A gem to scrape and analyze craigslist data
Support
Quality
Security
License
Reuse
Get Aliexpress product details in JSON
Support
Quality
Security
License
Reuse
:spider: The PHP SERP Spider - A search engine scraper
Support
Quality
Security
License
Reuse
Scrape URLs that contain an incrementing integer ID in the path
Support
Quality
Security
License
Reuse
Search reddit with CLI
Support
Quality
Security
License
Reuse
Golang pkg to quickly return a preview of a webpage (title/description/images)
Support
Quality
Security
License
Reuse
Scrape horse racing results data and racecards.
Support
Quality
Security
License
Reuse
This is a simple application for scraping and parsing food recipe data found on the web in hRecipe format, producing results in json
Support
Quality
Security
License
Reuse
A Python API that scrapes movie information from Netflix. A nice substitute for their now-privatized API. Used by http://www.tomatoflix.com
Support
Quality
Security
License
Reuse
:earth_americas: :hotel: Scrape Booking.com :hotel: :earth_americas:
Support
Quality
Security
License
Reuse
Django project to scrape a news website using Beautiful soup and display in our template.
Support
Quality
Security
License
Reuse
OSINT Tool gets a range of information from an Instagram account 🛠
Support
Quality
Security
License
Reuse
Instagram application for Django.
Support
Quality
Security
License
Reuse
Intelligent Web Data Extractor
Support
Quality
Security
License
Reuse
Web scraping Page Objects core library
Support
Quality
Security
License
Reuse
People also ask Google scraper. Get as many questions as you need to optimize your site for voice or new content ideas or answering questions about your desired topic.
Support
Quality
Security
License
Reuse
s
search-googleby DanMcInerney
Scrape google search results
Python 87Updated: 4 y ago License: Permissive (Apache-2.0)
87Updated: 4 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
h
html2rssby html2rss
📰 Build RSS 2.0 feeds from websites (and JSON APIs) with a few CSS selectors.
Ruby 87Updated: 2 y ago License: Permissive (MIT)
87Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
d
dkb-roboby grindsa
library to access the internet banking area of "Deutsche Kreditbank" to get account information and transactions
HTML 86Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
86Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
a
amazon-reviews-scraperby philipperemy
Yet another multi language scraper for Amazon targeting reviews.
Python 85Updated: 4 y ago License: Permissive (Apache-2.0)
85Updated: 4 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
v
visdomby fefit
A library use jQuery like API for html parsing & node selecting & node mutation, suitable for web scraping and html confusion.
Rust 85Updated: 2 y ago License: Permissive (MIT)
85Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
T
TwitterScraperby MatthewWolff
Scrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!
Python 84Updated: 2 y ago License: Permissive (MIT)
84Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
t
the-weather-scraperby Karlheinzniebuhr
A Lightweight Weather Scraper
Python 84Updated: 2 y ago License: No License (No License)
84Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
t
tatooineby obetomuniz
A powerful scraper for JavaScript Developers.
TypeScript 84Updated: 1 y ago License: Proprietary (Proprietary)
84Updated: 1 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
P
PHP-IMDb-Scraperby abhinayrathore
PHP IMDb Scraping API
PHP 84Updated: 3 y ago License: Permissive (MIT)
84Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
L
LinkedIn-Scraperby TufayelLUS
A LinkedIn Scraper to scrape up to 10k LinkedIn profiles from company profile links and save their e-mail addresses if available!
Python 84Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
84Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
i
instagramyby yogeshwaran01
Python Package for Instagram Users, Posts, and Hashtag data.
Python 84Updated: 3 y ago License: Permissive (MIT)
84Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
S
SEcraperby zerobyte-id
Search engine scraper tool with BASH script.
Shell 84Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
84Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
d
daily-scraperby dailydotdev
Fetches information about every webpage 🤖
HTML 84Updated: 2 y ago License: Strong Copyleft (AGPL-3.0)
84Updated: 2 y ago License: Strong Copyleft (AGPL-3.0)Support
Quality
Security
License
Reuse
y
yt-videos-listby slow-but-steady
Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.
Python 83Updated: 2 y ago License: Permissive (Apache-2.0)
83Updated: 2 y ago License: Permissive (Apache-2.0)Support
Quality
Security
License
Reuse
f
facebook-friends-ranking-scoreby arjun024
Find your Facebook Friends Ranking Score http://arjunsreedharan.org/post/65979958297/find-your-facebook-friends-ranking-score
JavaScript 82Updated: 4 y ago License: Permissive (MIT)
82Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
n
node-google-search-scraperby thibauts
Google search scraper with captcha solving support
JavaScript 82Updated: 4 y ago License: Permissive (MIT)
82Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
b
bet365-scraperby thereals0beit
Bet365.com soccer scraper
PHP 82Updated: 1 y ago License: Permissive (MIT)
82Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
T
TikTokPyby Russell-Newton
Extract data from TikTok without needing any login information or API keys.
Python 82Updated: 1 y ago License: Permissive (MIT)
82Updated: 1 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
h
haktldextractby hakluke
Extract domains/subdomains from URLs en masse
Go 81Updated: 3 y ago License: No License (No License)
81Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
g
google-covid19-mobility-reportsby vitorbaptista
Data extraction of Google's COVID-19 Mobility Reports
HTML 81Updated: 4 y ago License: Permissive (MIT)
81Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
A
Aine-MDby Aiinne
Free to use and not for sale. This repo uses scrape or data.json
JavaScript 81Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
81Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
i
instastories-backupby tensojka
Backup your friends' Instagram Stories forever and get to keep them even after 24 hours.
Python 80Updated: 4 y ago License: Permissive (MIT)
80Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
P
Python-Web-Scraping-Second-Editionby PacktPublishing
Python Web Scraping Second Edition, published by Packt
Python 80Updated: 4 y ago License: No License (No License)
80Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
D
Support
Quality
Security
License
Reuse
C
C64Publicby martinpiper
All my public C64 stuff
C++ 80Updated: 3 y ago License: Proprietary (Proprietary)
80Updated: 3 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
d
double-agentby ulixee
A test suite of common scraper detection techniques. See how detectable your scraper stack is.
TypeScript 80Updated: 3 y ago License: Permissive (MIT)
80Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
o
odds-portal-scraperby gingeleski
Sports odds and results scraping for Odds Portal (oddsportal.com).
Python 79Updated: 2 y ago License: Permissive (Unlicense)
79Updated: 2 y ago License: Permissive (Unlicense)Support
Quality
Security
License
Reuse
s
script.module.openscrapersby a4k-openproject
OpenScrapers Project
Python 79Updated: 4 y ago License: Strong Copyleft (GPL-3.0)
79Updated: 4 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
f
flickr_scraperby ultralytics
Simple Flickr Image Scraper
Python 79Updated: 3 y ago License: Strong Copyleft (GPL-3.0)
79Updated: 3 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
y
youtube-comment-scraper-cliby philbot9
Command line utility for scraping YouTube comments.
JavaScript 79Updated: 4 y ago License: Permissive (ISC)
79Updated: 4 y ago License: Permissive (ISC)Support
Quality
Security
License
Reuse
P
PittAPIby pittcsc
An API to easily get data from the University of Pittsburgh
Python 79Updated: 3 y ago License: Strong Copyleft (GPL-2.0)
79Updated: 3 y ago License: Strong Copyleft (GPL-2.0)Support
Quality
Security
License
Reuse
h
housing_scrapperby rodrigouroz
A script to scrap housing listings sites
Python 78Updated: 2 y ago License: No License (No License)
78Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse
r
rymscraperby dbeley
Python API to extract data from rateyourmusic.com.
Python 78Updated: 2 y ago License: Permissive (MIT)
78Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
O
OwnYourGramby aaronpk
📷 Save your Instagram photos to your own website!
PHP 78Updated: 3 y ago License: No License (No License)
78Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
c
craigslist_scraperby mark-nery
A gem to scrape and analyze craigslist data
Ruby 77Updated: 4 y ago License: Permissive (MIT)
77Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
a
aliexscrapeby ducdev
Get Aliexpress product details in JSON
JavaScript 77Updated: 3 y ago License: Permissive (MIT)
77Updated: 3 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
c
coreby serp-spider
:spider: The PHP SERP Spider - A search engine scraper
PHP 77Updated: 4 y ago License: Proprietary (Proprietary)
77Updated: 4 y ago License: Proprietary (Proprietary)Support
Quality
Security
License
Reuse
i
iterscraperby philipithomas
Scrape URLs that contain an incrementing integer ID in the path
Go 77Updated: 4 y ago License: Permissive (MIT)
77Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
r
Support
Quality
Security
License
Reuse
g
goscraperby badoux
Golang pkg to quickly return a preview of a webpage (title/description/images)
Go 76Updated: 4 y ago License: Permissive (MIT)
76Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
r
rpscrapeby joenano
Scrape horse racing results data and racecards.
Python 76Updated: 3 y ago License: No License (No License)
76Updated: 3 y ago License: No License (No License)Support
Quality
Security
License
Reuse
r
recipebookby dpapathanasiou
This is a simple application for scraping and parsing food recipe data found on the web in hRecipe format, producing results in json
Python 74Updated: 4 y ago License: Permissive (MIT)
74Updated: 4 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
s
scraping-netflixby jameskang410
A Python API that scrapes movie information from Netflix. A nice substitute for their now-privatized API. Used by http://www.tomatoflix.com
Python 74Updated: 4 y ago License: No License (No License)
74Updated: 4 y ago License: No License (No License)Support
Quality
Security
License
Reuse
B
BookingScraperby ZoranPandovski
:earth_americas: :hotel: Scrape Booking.com :hotel: :earth_americas:
Python 74Updated: 2 y ago License: Strong Copyleft (GPL-3.0)
74Updated: 2 y ago License: Strong Copyleft (GPL-3.0)Support
Quality
Security
License
Reuse
N
News-Aggregatorby sakship31
Django project to scrape a news website using Beautiful soup and display in our template.
Python 74Updated: 1 y ago License: No License (No License)
74Updated: 1 y ago License: No License (No License)Support
Quality
Security
License
Reuse
S
SoIGby yezz123
OSINT Tool gets a range of information from an Instagram account 🛠
Python 74Updated: 2 y ago License: Permissive (MIT)
74Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
d
django-instagramby marcopompili
Instagram application for Django.
JavaScript 74Updated: 3 y ago License: Permissive (BSD-3-Clause)
74Updated: 3 y ago License: Permissive (BSD-3-Clause)Support
Quality
Security
License
Reuse
w
webdextby seagatesoft
Intelligent Web Data Extractor
HTML 74Updated: 2 y ago License: Permissive (MIT)
74Updated: 2 y ago License: Permissive (MIT)Support
Quality
Security
License
Reuse
w
web-poetby scrapinghub
Web scraping Page Objects core library
Python 73Updated: 2 y ago License: Permissive (BSD-3-Clause)
73Updated: 2 y ago License: Permissive (BSD-3-Clause)Support
Quality
Security
License
Reuse
p
people-also-askby sundios
People also ask Google scraper. Get as many questions as you need to optimize your site for voice or new content ideas or answering questions about your desired topic.
Python 73Updated: 2 y ago License: No License (No License)
73Updated: 2 y ago License: No License (No License)Support
Quality
Security
License
Reuse