wget2 | Contributions | HTTP library
kandi X-RAY | wget2 Summary
kandi X-RAY | wget2 Summary
GNU Wget2 is the successor of GNU Wget, a file and recursive website downloader. Designed and written from scratch it wraps around libwget, that provides the basic functions needed by a web client. Wget2 works multi-threaded and uses many features to allow fast operation. In many cases Wget2 downloads much faster than Wget1.x due to HTTP2, HTTP compression, parallel connections and use of If-Modified-Since HTTP header. GNU Wget2 is licensed under GPLv3+. Libwget is licensed under LGPLv3+.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of wget2
wget2 Key Features
wget2 Examples and Code Snippets
Community Discussions
Trending Discussions on wget2
QUESTION
I'm trying to compile the code from wget2 into an exe.
First I downloaded the files from here: https://github.com/rockdaboot/wget2
I installed Nodejs v8.2.1
Then started following the instructions here: https://github.com/rockdaboot/wget2
I'm currently stuck at the ./bootstrap command listed under "Build from git".
...ANSWER
Answered 2017-Aug-02 at 05:16That type of command is supposed to by executed in a bash, not in a CMD where './' is not interpreted correctly.
You can try as a mingw bash the one provided by Git: just unzip PortableGit-2.13.3-64-bit.7z.exe
and add Git to your PATH
QUESTION
How can I download all files (in parallel) using wget2 or aria from here: ftp://ftp.soilgrids.org/data/recent/
I tried aria2c -j 8 ftp://ftp.soilgrids.org/data/recent/
but it does not do anything (and does not show any error message either)
I am on windows
...ANSWER
Answered 2017-Feb-06 at 09:32wget
is not multi-threaded, so you would need to somehow split the URLs in packages and invoke the program multiple times. On the other hand, aria2
is not able to recursively download. Since you're on Windows, I can't assume much useful besides cmd
and the given wget
and aria2
.
We can download the directory listing with wget
and construct a text file with the URLs for aria2
to download in parallel. A little batch file will massage the data correspondingly:
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install wget2
autotools (autoconf, autogen, automake, autopoint, libtool)
python (recommended for faster bootstrap)
rsync
tar
makeinfo (part of texinfo)
pkg-config >= 0.28 (recommended)
doxygen (for creating the documentation)
pandoc (for creating the wget2 man page)
gettext >= 0.18.2
libiconv (needed for IRI and IDN support)
libz >= 1.2.3 (the distribution may call the package zlib*, eg. zlib1g on Debian)
liblzma >= 5.1.1alpha (optional, if you want HTTP lzma decompression)
libbz2 >= 1.0.6 (optional, if you want HTTP bzip2 decompression)
libbrotlidec/libbrotli >= 1.0.0 (optional, if you want HTTP brotli decompression)
libzstd >= 1.3.0 (optional, if you want HTTP zstd decompression)
libgnutls (3.3, 3.5 or 3.6)
libidn2 >= 0.14 (libidn >= 1.25 if you don't have libidn2)
flex >= 2.5.35
libpsl >= 0.5.0
libnghttp2 >= 1.3.0 (optional, if you want HTTP/2 support)
libmicrohttpd >= 0.9.51 (optional, if you want to run the test suite)
lzip (optional, if you want to build distribution tarballs)
lcov (optional, for coverage reports)
libgpgme >= 0.4.2 (optional, for automatic signature verification)
libpcre | libpcre2 (optional, for filtering by PCRE|PCRE2 regex)
libhsts (optional, to support HSTS preload lists)
libwolfssl (optional, to support WolfSSL instead of GnuTLS)
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page