lab | A customisable 3D platform for agent-based AI research | Machine Learning library

So, this is a good opportunity to use purrr::map. You are half way there by applying code to one dataframe.

You can take the code that you have written above and put it into a function.

We can loop over the list 'l' with lapply, then get the table for each of the columns by looping over the columns with sapply after converting the column to factor with levels specified as 'u', get the proportions, transpose, convert to data.frame (as.data.frame), split by row (asplit - MARGIN = 1), then use transpose from purrr to change the structure so that each column from all the list elements will be blocked as a single unit, bind them with bind_rows

Multiple things could cause this behaviour, because the pipeline runs fine with less Data, analysing what has changed could lead us to a resolution.

The third line of the logs you provide might indicate that you're processing unclean data in your bigger pipeline mmap(NULL, could mean that | "Get Content" >> beam.Map(lambda x: x.read_utf8()) is trying to read a null value.

Is there an empty file somewhere ? Are your files utf8 encoded ?

I'm guessing using the fileio.ReadMatches() will try to load into memory the whole file, if your file is bigger than your memory, this could lead to errors. Can you split your data into smaller files ?

If files are too big for your current machine with a DirectRunner you could try to use an on-demand infrastructure using another runner on the Cloud such as DataflowRunner

Your code has an error in it, which is the use of break statements within the if and else clauses. If you remove the breaks, it should work.

break statements can only be used within for/while loops and switch statements. You can't use them (and don't need them) in if/else statements.

If you click "run code snippet" on your example, it shows the error message Uncaught SyntaxError: Illegal break statement which would help you find this issue. Also, if you open your browser's JavaScript console, you should find this error message where you are running your code. This will help you find and fix errors in the future.

When you know all your 90 bacci names in front of plotting, you can try.

Tidyverse solution: You use your inputs to filter the dataset, right before plotting it. Therefore you need to get the data in long format with tidyr::pivot_longer() before.
Afterwards you can filter here:

Answer

You have to add the font.family argument to fviz_pca:

Flipping the 2nd plot

To achieve this, we need to add two functions:

• scale_y_reverse: This will flip the y axis; 0 is at the top, 10 at the bottom.
• scale_x_discrete(position = top): This will put the x-axis at the top.

Fixing the y-axis limits

It would be best to keep the same y-axis limits for both plots, to make them comparable. As such, we have to supply ylim() to the first plot. For the second plot, we already have scale_y_reverse, so we can supply our limits there.

Fixing the x labels

Since you only want the labels to appear once, you'd have to use element_blank() for theme(axis.text.x) and theme(axis.title.x) in the 2nd plot. Similarly, I would remove the x-axis title in the first plot to keep it balanced.

Combining the plots

Now, you want to combine the plots. However, the first plot has a lot of information on the x-axis, while the second plot doesn't. This means they have different heights. I like to use cowplot::plot_grid for combining plots, because it allows you to set the relative height of the plots. In this case, we can use it to account for the height difference between the two plots.

Final code

You can specify the legend shape using key_glyph and then manually specify the shape by type the same way you have done for fill.