jsonframe-cheerio | simple multi-level scraper json input/output for Cheerio | Scraper library

by gahabeen JavaScript Version: 3.0.1 License: MIT

X-Ray Key Features Code Snippets Community Discussions(1)Vulnerabilities Install Support

kandi X-RAY | jsonframe-cheerio Summary

jsonframe-cheerio is a JavaScript library typically used in Automation, Scraper, Selenium applications. jsonframe-cheerio has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. You can install using 'npm i jsonframe-cheerio' or download it from GitHub, npm.

simple multi-level scraper json input/output for Cheerio

Support

Quality

Security

License

Reuse

Support

jsonframe-cheerio has a low active ecosystem.

It has 196 star(s) with 22 fork(s). There are 6 watchers for this library.

It had no major release in the last 12 months.

There are 4 open issues and 2 have been closed. On average issues are closed in 2 days. There are 3 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of jsonframe-cheerio is 3.0.1

Quality

jsonframe-cheerio has 0 bugs and 0 code smells.

Security

jsonframe-cheerio has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

jsonframe-cheerio code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

jsonframe-cheerio is licensed under the MIT License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

jsonframe-cheerio releases are not available. You will need to build from source code and install.

Deployable package is available in npm.

Installation instructions are not available. Examples and code snippets are available.

jsonframe-cheerio saves you 21 person hours of effort in developing the same functionality from scratch.

It has 58 lines of code, 0 functions and 3 files.

It has low code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of jsonframe-cheerio

Get all kandi verified functions for this library.

jsonframe-cheerio Key Features

No Key Features are available at this moment for jsonframe-cheerio.

jsonframe-cheerio Examples and Code Snippets

No Code Snippets are available at this moment for jsonframe-cheerio.

Community Discussions

Trending Discussions on jsonframe-cheerio

Can't scrap all the data cheerio - node.js

QUESTION

Can't scrap all the data cheerio - node.js

Asked 2019-Oct-27 at 08:27

js noob here,

I'm trying to create a web scraper to scrap price data off booking websites, but I can't get the data I want, at least not every time.

I'm testing this specific url:

https://www.trivago.fr/?aDateRange%5Barr%5D=2019-10-09&aDateRange%5Bdep%5D=2019-10-10&aPriceRange%5Bfrom%5D=0&aPriceRange%5Bto%5D=0&iRoomType=7&aRooms%5B0%5D%5Badults%5D=2&cpt2=22748%2F200&iViewType=0&bIsSeoPage=0&sortingId=1&slideoutsPageItemId=&iGeoDistanceLimit=20000&address=&addressGeoCode=&offset=0&ra=

This is what I get 1 in 20 attempts:

...

ANSWER

Answered 2019-Oct-27 at 08:27

Website you're parsing, Trivago, use AJAX with the following requests: https://cdn-hs-graphql-dus.trivago.com/graphql. You can parse the response using JSON parser, so you should learn about it if you doesnt want to parse with Puppeteer.
If you doesn't want to spying those request (using chrome devtools), i suggest you to use Puppeteer. In puppeteer, you can use the waitForSelector method. For example, if you want to get some hotels name and price, you can wait the selector to be available in the DOM, or just wait for some seconds.
If you want to extract some data with jsonframe, you should also learn some more about CSS selector. I prefer to use [itemtype=""] and [itemprop=""] attribute since this selector is reliable and fast to find.
https://css-tricks.com/how-css-selectors-work/
To display the data, you can use console.log, but if you prefer to use node.js as server, i suggest you to use express.
To make your script running fast, you can block images from request, by using interceptor.
In your code above, you're missing the link between cheerio and jsonframe jsonframe($)
You can use these codes as an example.