theHarvester | E-mails , subdomains and names Harvester - OSINT | Security Testing library

by laramies Python Version: 0.0.1 License: No License

kandi X-RAY | theHarvester Summary

theHarvester is a Python library typically used in Testing, Security Testing applications. theHarvester has no bugs, it has no vulnerabilities, it has build file available and it has medium support. You can install using 'pip install theHarvester' or download it from GitHub, PyPI.

theHarvester is a very simple to use, yet powerful and effective tool designed to be used in the early stages of a penetration test or red team engagement. Use it for open source intelligence (OSINT) gathering to help determine a company's external threat landscape on the internet. The tool gathers emails, names, subdomains, IPs and URLs using multiple public data sources that include:.

Support

Quality

Security

License

Reuse

kandi-support Support

theHarvester has a medium active ecosystem.
It has 8015 star(s) with 1720 fork(s). There are 286 watchers for this library.
It had no major release in the last 12 months.
There are 12 open issues and 344 have been closed. On average issues are closed in 54 days. There are 3 open pull requests and 0 closed requests.
It has a neutral sentiment in the developer community.
The latest version of theHarvester is 0.0.1

theHarvester Support

Best in #Security Testing

Average in #Security Testing

theHarvester Support

Best in #Security Testing

Average in #Security Testing

quality kandi Quality

theHarvester has 0 bugs and 0 code smells.

theHarvester Quality

Best in #Security Testing

Average in #Security Testing

theHarvester Quality

Best in #Security Testing

Average in #Security Testing

security Security

theHarvester has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.
theHarvester code analysis shows 0 unresolved vulnerabilities.
There are 0 security hotspots that need review.

theHarvester Security

Best in #Security Testing

Average in #Security Testing

theHarvester Security

Best in #Security Testing

Average in #Security Testing

license License

theHarvester does not have a standard license declared.
Check the repository for any license declaration and review the terms closely.
Without a license, all rights are reserved, and you cannot use the library in your applications.

theHarvester License

Best in #Security Testing

Average in #Security Testing

theHarvester License

Best in #Security Testing

Average in #Security Testing

build Reuse

theHarvester releases are available to install and integrate.
Deployable package is available in PyPI.
Build file is available. You can build the component from source.
Installation instructions are available. Examples and code snippets are not available.
theHarvester saves you 1800 person hours of effort in developing the same functionality from scratch.
It has 4252 lines of code, 337 functions and 72 files.
It has medium code complexity. Code complexity directly impacts maintainability of the code.

theHarvester Reuse

Best in #Security Testing

Average in #Security Testing

theHarvester Reuse

Best in #Security Testing

Average in #Security Testing

Top functions reviewed by kandi - BETA

kandi has reviewed theHarvester and discovered the below as its top functions. This is intended to give you an instant insight into theHarvester implemented functionality, and help decide if they suit your requirements.

This function returns a boolean indicating whether the user is responding to a URL

Return the user - agent string
Perform a GET request
Return True if text appears in Google Cloud

The main entry point

Searches for vhosts
Return a list of hostnames
Start the harvester

Process the results

Do the search
Return a SuccessResult instance
Return a list of supported proxies

Process search results

Do a search
Fetch data from a given URL
Fetch multiple urls

Check all hosts

Query a host
Query all hosts

Return a list of email addresses

Clean the results
Find unique email addresses

Returns a list of urls

Performs the search

Process the intelx command

Perform search

Get all kandi verified functions for this library.

theHarvester Key Features

E-mails, subdomains and names Harvester - OSINT

theHarvester Examples and Code Snippets

See all related Code Snippets

Community Discussions

Trending Discussions on theHarvester

Python Error using subprocess without shell=false and variable from an array
Convert Bash Install script to Python

Trending Discussions on theHarvester

QUESTION

Python Error using subprocess without shell=false and variable from an array

Asked 2019-Mar-02 at 23:08

I have the code snippet that works with shell=True which isn't secure and when i attempt to remove shell=True and include shell=False the program errors out

The code is below:

cmd = "git clone https://github.com/{} &"    
#define a worker function
def worker():
    while True:
        item = q.get()
        subprocess.Popen(cmd.format(item))
        q.task_done()

I get the error below:

File "rapid.py", line 56, in worker
    subprocess.Popen(cmd.format(item))
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/subprocess.py", line 775, in __init__
    restore_signals, start_new_session)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/subprocess.py", line 1522, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: 'git clone https://github.com/laramies/theHarvester.git &': 'git clone https://github.com/laramies/theHarvester.git &'

if i add shell = True to the subprocess line it runs just fine (see below) but then code factor flags it as insecure code. Any way to do this without shell = true?

cmd = "git clone https://github.com/{} &"    
#define a worker function
def worker():
    while True:
        item = q.get()
        subprocess.Popen(cmd.format(item), shell = True)
        q.task_done()

ANSWER

Answered 2019-Mar-02 at 23:08

The command is being passed to subprocess.Popen as a string. This works when using shell=True because the shell can accept a command as a single string. But when shell=False, Popen expects the command as a list of arguments, the first one being the full path of the program to run. (This is assuming you're on a POSIX machine, not Windows.)

Essentially, the code says "Run a program called git clone https://github.com/laramies/theHarvester.git with no arguments" instead of "Run git with arguments clone and https://github.com/laramies/theHarvester.git".

The & should also be removed because that is a shell feature and with shell=False it would be passed to git as an argument it won't understand. You don't need it though, since the process will run in the background anyway.

Something like this should work:

subprocess.Popen(["/usr/bin/git", "clone", "https://github.com/{}".format(item)])

More info here: https://docs.python.org/3.7/library/subprocess.html#popen-constructor

Source https://stackoverflow.com/questions/54963057

QUESTION

Convert Bash Install script to Python

Asked 2019-Jan-06 at 06:08

I have the following bash script below and would like to convert it over to Python and eventually add error handling.

I tried to do arrays and read them in like in bash but i could not find an easy way in Python. Any ideas please?

#!/bin/bash
repos=("BloodHoundAD/BloodHound.git" "GhostPack/Seatbelt.git" "GhostPack/SharpUp.git" "yeyintminthuhtut/Awesome-Red-Teaming.git"
"byt3bl33d3r/DeathStar.git" "byt3bl33d3r/CrackMapExec.git" "Cn33liz/p0wnedShell.git" "EmpireProject/Empire.git"
"danielmiessler/SecLists.git" "laramies/theHarvester.git")
for i in "${repos[@]}"; do
  git clone http://github.com/$i
done
echo "There are ${#repos[@]} repos here"

Thanks to the great help by the users below:

My updated code in Python is below. Hope it helps someone

import os
import subprocess

repos=["BloodHoundAD/BloodHound.git", "GhostPack/Seatbelt.git", "GhostPack/SharpUp.git", "yeyintminthuhtut/Awesome-Red-Teaming.git",
"byt3bl33d3r/DeathStar.git", "byt3bl33d3r/CrackMapExec.git", "Cn33liz/p0wnedShell.git", "EmpireProject/Empire.git",
"danielmiessler/SecLists.git", "laramies/theHarvester.git"]

for repo in repos:
    subprocess.Popen("git clone https://github.com/{}".format(repo) , shell=True).wait()

print ("There are {} repos in the array.".format(str(len(repos))))

ANSWER

Answered 2019-Jan-06 at 03:15

First, we covert repos into a python list. So:

repos=["BloodHoundAD/BloodHound.git", "GhostPack/Seatbelt.git", "GhostPack/SharpUp.git", "yeyintminthuhtut/Awesome-Red-Teaming.git",
"byt3bl33d3r/DeathStar.git", "byt3bl33d3r/CrackMapExec.git", "Cn33liz/p0wnedShell.git", "EmpireProject/Empire.git",
"danielmiessler/SecLists.git", "laramies/theHarvester.git"]

Then, we create a for loop in python. In that for loop, we run git clone package. Instead of using a library, we can just run it through os.system().

Therefore, the for loop code is:

for repo in repos:
    os.system("git clone http://github.com/{}".format(repo))

Finally, we get the amount of repos in the list and print it out, which we do with print ("There are {} repos.".format(str(len(repos))))

The full code is:

import os

repos=["BloodHoundAD/BloodHound.git", "GhostPack/Seatbelt.git", "GhostPack/SharpUp.git", "yeyintminthuhtut/Awesome-Red-Teaming.git",
"byt3bl33d3r/DeathStar.git", "byt3bl33d3r/CrackMapExec.git", "Cn33liz/p0wnedShell.git", "EmpireProject/Empire.git",
"danielmiessler/SecLists.git", "laramies/theHarvester.git"]

for repo in repos:
    os.system("git clone http://github.com/{}".format(repo))


print ("There are {} repos.".format(str(len(repos))))

Source https://stackoverflow.com/questions/54058276

Community Discussions, Code Snippets contain sources that include Stack Exchange Network