Python Programming: Beyond the Basics

Best job scrapers - Scrape job postings from indeed, linkedin, xing

:arrow_double_down: Dumb downloader that scrapes the web

Other

you-get

MIT License

requests-html

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.

twint

News, full-text, and article metadata extraction in Python 3. Advanced docs:

newspaper

Goutte

portia

Scrapes an instagram user's photos and videos

The Unlicense

instagram-scraper

The next web scraper. See through the <html> noise.

x-ray

Apache License 2.0

ferret

Download pictures (or videos) along with their captions and other metadata from Instagram.

Scraper Kits (Sorted by Popularity)

Open Weaver – Develop Applications Faster with Open Source

kandi

Community and Support

Company

Follow