tw | - Twitter client on Ruby

if i understood the problem correctly you can try not to use list structure, edit it like this

All

in your case i would advice changing this:

What I do not understand is what the integers are right after the strings.

See the TJ operator, where each number adjusts (subtracts) from the text matrix. For example, this syntax can be used to do Kerning on the text runs.

See Table 109 page 258 (numbered at the bottom 250 here : https://www.adobe.com/content/dam/acom/en/devnet/pdf/pdfs/PDF32000_2008.pdf

The issue is that you’ve loaded and attached the ‘crqa’ package in your main execution environment, but the cluster nodes are running code in separate, isolated R sessions — they don’t see the same loaded packages or global variables!

The easiest solution is to replace use of wincrqa with a fully qualified name, i.e. to use crqa::wincrqa inside your function.

Alternatively, it is possible to attach the ‘crqa’ package on all cluster nodes prior to executing the function:

You need to use clusterMap() or another function from the parallel package rather than base::Map.

Look those options up with: ?parallel::clusterMap.

You are also currently mixing things up by introducing registerDoParallel(cl), which is from the foreach package. That would require you to then use foreach() and its helper %dopar%. If you do not use foreach() then you do not need registerDoParallel(cl).

The relevant part of your code would look something like this with clusterMap(). I've tidied it a bit but I can't test it on my machine.

First forward-fill your Amount column values to fill in all blanks. This is done to find when Amount changes. Shift the StartDate values back by 1, which will be used to fill into EndDate column wherever Amount change is detected:

API.search uses Twitter's standard search API and doesn't accept date_since or date_until parameters:

Keep in mind that the search index has a 7-day limit. In other words, no tweets will be found for a date older than one week.

https://developer.twitter.com/en/docs/twitter-api/v1/tweets/search/guides/standard-operators also says:

[It] is not a complete index of all Tweets, but instead an index of recent Tweets. The index includes between 6-9 days of Tweets.

You'll need to use the Full-archive premium search API endpoint, with API.search_full_archive, instead.

1. Variables inside and outside of the function argument of page.evaluate() are not the same: they are copied while transferred between Node.js and browser contexts. So while you change properties inside page.evaluate(), the properties outside remains unchanged. While you use return properties; inside page.evaluate(), you are not save the returned value.

2. You forget to return value in scrapeStreams().

However, it seems there are some other issues in your code (many null are returned), but you may use another question for them.

ENV keywork does not expand anything unfortunately.

The only solution is:

Dockerfile