parlapi | Web service to provide Canadian Parliamentary info
kandi X-RAY | parlapi Summary
kandi X-RAY | parlapi Summary
Web service to provide Canadian Parliamentary info in nice Web 2.0 formats
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of parlapi
parlapi Key Features
parlapi Examples and Code Snippets
Community Discussions
Trending Discussions on parlapi
QUESTION
I have a script which queries successfully an API, but is very slow. It will take around 16 hours to get all the resources. I looked at how I could optimise it, and I thought that using GNU parallels (installed on macos via Brew, version 20180522) would do the trick. But even with using 90 jobs (the API endpoints authorizes 100 connections max), my script is not faster. I'm not sure why.
I call my script like so:
...ANSWER
Answered 2018-May-29 at 13:02Your script loops over a list of URLs and queries them sequentially. You need to break it up so each API query is done separately, that way parallel
will have commands it can execute in parallel.
Change the script so it takes a single URL. Get rid of the main while
loop.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install parlapi
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page