integration | Rails plugin that provides a set of tasks to automate | Continous Integration library

I have a Spring Boot app with a Kafka Listener implementing the BatchAcknowledgingMessageListener interface. When I receive what should be a single message from the topic, it's actually one message for each line in the original message, and I can't cast the message to a ConsumerRecord.

The code producing the record looks like this:

I have a dataset with the name of Danish ministers and their position from 1990 to 2020 (data comes from dataset called WhoGovern; https://politicscentre.nuffield.ox.ac.uk/whogov-dataset/). The dataset consists of the ministers name, the ministers position, the prestige of that position, and the year in which the minister had that given position.

My problem is that some ministers are counted twice in the same year (i.e., the rows aren't unique in terms of name and year). See the example in the picture below, where "Bertel Haarder" was both Minister of Health and Minister of Interior Affairs in 2010 and 2021.

I want to create a dataset, where all the rows are unique combinations of name and year. However, I do not want to remove any information from the dataset. Instead, I want to use the information in the prestige column to combine the duplicated rows into one. The observations with the highest prestige should be the main observations, where the other information should be added in a new column, e.g., position2 and prestige2. In the example with Bertel Haarder the data should look like this:

(PS: Sorry for bad presenting of the tables, but didn't know how to create a nice looking table...)

Here's the dataset for creating a reproducible example with observations from 2010-2020:

I am working on an integration into an old API which for some reason returns the json data as a text/html response. I have tried to Deserialse this string using Newtonsoft in C# and also using various javascript libraries including JSON.parse() but all have failed.

The actual response looks like a valid json object but it fails to get deserialised:

{"err":201,"errMsg":"We cannot find your account.\uff01","data":[],"selfChanged":{}}

I am taking it that there are some special characters or that the actual response is in a format that any of my parsers cannot not deserialise out the box. I have attached various code samples in various languages including curl. I would really appreciate if someone could help deserialise the response object in C# or point me in the right direction.

C#

I am working on a CI config to push to multiple projects in remote server.

So I temporary push them on github public project, which have a config.cfg file contains these line below.

I want to retrieve data from a api call which will return the server timezone details. This is the url I want to hit: https://10.77.44.104/webrtmt/rest/logcollection/getTimeZone

And the data is in this format when I currently open the link :

I followed the instructions at Structured Streaming + Kafka and built a program that receives data streams sent from kafka as input, when I receive the data stream I want to pass it to SparkSession variable to do some query work with Spark SQL, so I extend the ForeachWriter class again as follows:

It is time we enabled the Continuous Integration of the build pipeline, so when I went to do just that, i am seeing something strange...

The trigger appears to be enabled? yet theres a message suggesting webhooks are missing to the repo and need to be restored. When i click restore, it fails!

The remote repository’s webhooks are missing or incorrect.

Another branch was created on the upstream repo. Let's call it features/demo. Three branches now exist, Master, Develop and features/demo.

My forked repo only has Master and Develop. The forked repo is set as the origin and is my local cloned copy.

How do I pull the upstream branch into my local? Every time I try it wants to merge into Develop or Master because that's what any new branch I make is checked out from.

Edit:

I have a Python Apache Beam streaming pipeline running in Dataflow. It's reading from PubSub and writing to GCS. Sometimes I get errors like "Error in _start_upload while inserting file ...", which comes from: