onionscan | OnionScan Dark Web Crawler is a free and open-source tool
kandi X-RAY | onionscan Summary
kandi X-RAY | onionscan Summary
OnionScan Dark Web Crawler is a free and open-source tool for investigating the dark web. OnionScan is a free and open source tool for investigating the Dark Web https://github.com/s-rah/onionscan
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- ParsePage parses a page from an HTML response .
- Main entry point for testing
- GetOnionLinks returns links from an onion scan
- doScan mode scan
- ApacheModStatus fetches the status code for the given article
- Initialize initializes the crawlDB
- CommonCorrelations adds common relations to the graph
- PrivateKey is used to find the private key
- Configure creates a new onion scan configuration .
- Extract user defined relations
onionscan Key Features
onionscan Examples and Code Snippets
Community Discussions
Trending Discussions on onionscan
QUESTION
I've been trying out Onionscan recently after following a tutorial on building an Onionscan Scraper using a Python wrapper. Since the tutorial was written Onionscan has shifted from storing all data in JSON files, to storing some of it in a database built using Tiedot.
I am trying to find a way of taking one of the files which has no extension, simply named dat_0
and parsing it using Python.
Looking at dat_0
in macOS Textedit I get the following...
Whilst Sublime Text displays it as...
I have been trying to work out how to parse this file using Python. I'm presuming from Tiedot's docs and the view via Textedit that it uses JSON structures, but I've not had much luck.
...ANSWER
Answered 2017-May-04 at 14:30For anyone that finds this in the future, I found a solution myself. I used Kaitai Struct to create a binary parser for the Tiedot file structure. Kaitai can create parsers for a multitude of languages so it's quite a useful tool
The Kaitai structure I used to generate the parser is...
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install onionscan
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page