cocot | cocot - COde COnverter on Tty
kandi X-RAY | cocot Summary
kandi X-RAY | cocot Summary
cocot - COde COnverter on Tty. Copyright (c) 2002-2017 IWAMURO Motonori All rights reserved.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of cocot
cocot Key Features
cocot Examples and Code Snippets
Community Discussions
Trending Discussions on cocot
QUESTION
I am trying to scrape this e-commerce website page (for learning purposes). But the problem however is that I cannot find any reference to next page in the HTML source code. Since the website uses infinite scrolling. I suspect this has a relation with what I am seeking, but even though if it was, I don't know how to extract next page from it.
...ANSWER
Answered 2019-Jul-24 at 15:11From the response you get back, you can see the total number here:
response.xpath('//*[@id="totalResultSearch"]/@value')
. You can base yourself on this to figure out how many requests you should make like this.
From the original page, you can also find this count back here: response.xpath('//*[@id="search-results"]/@value')
.
You can rewrite the start_requests & parse like this to get the right products:
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install cocot
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page