Open source for Open source! From tracking Elon Musk’s flights to critical activities like analyzing war crimes, financial irregularities, and tracking refugee relocation, open source intelligence is used by global analysts, and enthusiasts to surface vital information. Open source intelligence (OSINT) uncovers, processes, and reports insights from data obtained from public sources for different intelligence purposes. While traditional reporting has always focused on uncovering intelligence with public information, the proliferation of digital across all facets of life and the subsequent digital trail has paved the way for larger-scale OSINT. The initial practice started with cyber security and multiple experts looking for the next threat, attack surfaces, breaches, and others. But today, it has grown across security, law enforcement, geopolitics, human rights, competitive intelligence, and many other areas. The core tenet of OSINT is not to deal with classified information. The main sources for OSINT are digital media, citizen media (social), public government data, academic research, and network scans. Techniques include scraping or harvesting data, transforming it, and then analyzing and reporting it for use. This is usually done in volunteer groups, given the vast amount of data. Open source libraries help you automate open source intelligence gathering. Here are popular open source libraries for popular OSINT tools like web scrapers, Maltego, Amass, TinEye, Sentinel Hub, Shodan, Crowdtangle, InVID and others.
x-rayby matthewmueller
The next web scraper. See through the <html> noise.
x-rayby matthewmueller
JavaScript 5710 Version:2.3.4 License: Permissive (MIT)
autoscraperby alirezamika
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
autoscraperby alirezamika
Python 5239 Version:v1.1.14 License: Permissive (MIT)
shodan-pythonby achillean
The official Python library for Shodan
shodan-pythonby achillean
Python 2186 Version:1.28.0 License: Others (Non-SPDX)
sentinelhub-pyby sentinel-hub
Download and process satellite imagery in Python using Sentinel Hub services.
sentinelhub-pyby sentinel-hub
Python 705 Version:v3.9.1 License: Permissive (MIT)
MISP-maltegoby MISP
Set of Maltego transforms to inferface with a MISP Threat Sharing instance, and also to explore the whole MITRE ATT&CK dataset.
MISP-maltegoby MISP
Python 119 Version:v1.4.5 License: Strong Copyleft (AGPL-3.0)
sentinelhub-jsby sentinel-hub
Download and process satellite imagery in JavaScript or TypeScript using Sentinel Hub services.
sentinelhub-jsby sentinel-hub
TypeScript 50 Version:v0.2.95 License: Permissive (MIT)
invid-verification-pluginby AFP-Medialab
Code of the InVID EU project plugin for video and image verification
invid-verification-pluginby AFP-Medialab
JavaScript 16 Version:v073-sna-dev-beta-1 License: Others (Non-SPDX)
invid-verification-pluginby invideu
invid-verification-pluginby invideu
JavaScript 15 Version:Current License: Others (Non-SPDX)
tineyeservices_pythonby TinEye
Python library for TinEye Services (MatchEngine, MobileEngine, MulticolorEngine and WineEngine)
tineyeservices_pythonby TinEye
Python 10 Version:1.6.5 License: Permissive (MIT)
tineye-api-nodeby TinEye
Node.js library for the TinEye API
tineye-api-nodeby TinEye
JavaScript 10 Version:2.0.3 License: Permissive (MIT)
tineye-api-phpby TinEye
PHP library for the TinEye API