privacy-glasses | Privacy Glasses plugin for Obsidian Preserve your privacy while working in public! | Privacy library
kandi X-RAY | privacy-glasses Summary
kandi X-RAY | privacy-glasses Summary
"Privacy Glasses" plugin for Obsidian. Preserve your privacy when working in public!.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of privacy-glasses
privacy-glasses Key Features
privacy-glasses Examples and Code Snippets
Community Discussions
Trending Discussions on privacy-glasses
QUESTION
Hi guys so I'm creating a simple web scraper that is taking relevant articles and the dates that are shown in the headlines from cnet after searching for privacy. as shown in my code the link that it is using to pull the data, but I am having a problem. regardless of the page number that I add to the end of the url code, it is only scraping the first page. I have tested it with other urls and it pulls different data so I just don't understand why when I change the page number at the end of the URL it doesn't the specific data relevant to that page.
if possible I am trying to get it to pull data from all the pages but right now I am trying to get it to work with atleast one different page other than the main one that returns when you search for "privacy".
below is the python code
...ANSWER
Answered 2017-May-01 at 22:15You can confirm that the URL above will not redirect to the correct page by navigating to it via the browser directly. https://www.cnet.com/search/?query=privacy&page=6
in a browser will take you to page 1.
Reviewing the page selectors, etc. you can see that the pagination works by using the following:
2
(You can view this using the "Inspect" tool in Google Chrome, for example.)
Adding this updated endpoint to the URL will allow us to specify the page programatically. For example, to get to page 6, use this:
https://www.cnet.com/search/?query=privacy&fq=&sort=1&p=6&typeName=&rpp=10
Updating your code to use this URL (specifying the page in the &p=6
section) should fix the issue.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install privacy-glasses
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page