weather-forecast | Weather forecast app with big data tech stacks | Predictive Analytics library

Something you can start with.

my_api_data.php

It doesn't have to work at all, even if you didn't do anything wrong. Many sites use Javascript to fetch data, so you'd need to use some other scraper that has Chromium built-in and uses the same DOM that you'd see if you were interacting with the site yourself, in-person. And many sites with valuable data, such as weather data, actively protect themselves from scraping, since the data they provide has monetary value (i.e. you can buy the data feed access).

In any case, you should start with some site that's known to scrape well. Beautifulsoup's own webpage is a good start :)

And you should use a debugger to see the intermediate values your code generated, and investigate at which point they diverge from your expectations.

Comparaison are coded with == or ===...

So this is not good. if (list[i].weather[i].main = "Clear")

But list[i].weather[i] something doesn't exists, I know because it's there is a big red message that appears on the console just by running the code. You maybe wanted to use list[i].weather[0].

Here is a corrected code snippet

One way of doing it would be to loop over all the divs with class weather-entry and then extract the text out of each one, building a table structure along the way.

For example:

The reason it is printing like that is that Python is making newlines and tabs for each \n and \t in the data. To ignore these escape characters when printing, use the Python repr function.

Like this:

Well read_html can read tables in a html document. And the error text is right: the document contains no table, but is formatted using a bunch of div elements.

That means that pandas cannot process it directly. You should instead use BeautifulSoup to parse the html and extract the relevant info into lists and dictionaries, and then build a dataframe from those python containers.

The rule is that it depends on the page. The normal way is to use the developper's tools of your browser to see how the page is structured and identify the relevant elements. Then you control with display source that the elements were transmitted with the HTML and not through javascript. Here you are lucky because the data is directly inside the HTML part.

So you should:

• use requests or urllib.request to download the page
• use BeautifulSoup to extract the elements identified in the developper's tool of the browser
• concatenate everything

The website is loaded via JavaScript dynamically once the page loads. so you can use requests-html or selenium.

http://php.net/manual/en/book.curl.php, there are plenty of options that you can use with curl, by playing a bit the following code can work with your url.

You have incompatible dependencies

@angular/core@8.0.0 vs @angular/material@9.0.0

Angular 9 is comming to stackblitz but it doesn't work yet.

So the solution is to use version 8 of @angular/material package.

Forked Stackblitz

Note for Angular material 9:

Components in Material 9 version can no longer be imported through "@angular/material". Use the individual secondary entry-points, such as @angular/material/button.