company-reviews | Scrape Indeed for job listings
kandi X-RAY | company-reviews Summary
kandi X-RAY | company-reviews Summary
Scrape Indeed for all recent jobs listings matching given keywords, and then scrape Indeed and Glassdoor the reviews of the companies offering jobs. Plot the ratings, and use topic modeling on the reviews to understand how employees see their company. Visualize the topics. Written in python by Henri Dwyer.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Fix all company names in dic
- Fix the name of a company name
company-reviews Key Features
company-reviews Examples and Code Snippets
Community Discussions
Trending Discussions on company-reviews
QUESTION
I'm getting stuck at a webscrapping project, I would like to webscrape the following website and the dates for each of the reviews. However I get 'January 1970' for all of the dates. https://fairygodboss.com/company-reviews/ebay-inc
Here is my code:
...ANSWER
Answered 2018-Nov-16 at 17:48I believe your problem is that, when you make your request, you are not logged in. When a user is not logged in, all the dates appear as January 1970, until you are redirected to a login page. You will first have to log in.
This can be a tricky problem, but there is a library for python called twill that may work for you: http://twill.idyll.org
Alternatively, you could use something like the Mechanize library, which twill is based on.
This StackOverflow question should help you out: How to scrape a website that requires login first with Python
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install company-reviews
Scraping.ipynb
Ratings.ipynb
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page