circe | Circe : A High-Performance Hash Algorithm Framework & Library | Hashing library

You can ensure that both are JsonObjects and then pick all the keys of the new record and check whenever that key existed in the old record or not, and if it did exist then ensure that its contents are different.

From the comment and link of Asperi:

Change to:

I just forgot that as asObject returns an Option[JsonObject], so the isEmpty is just checking that it's Some 🙃

I'm not sure if this is what you need:

You can use downN method on HCursor to access particular element from a list.

This is default Circe behavior. Please, see for more details: https://github.com/circe/circe/issues/1267

And seems like not only for Circe, but in general JSON standard has no such thing as Nan, -Infinity, +Infinity, so in Circe, you can't even create Json for Double.Nan: https://github.com/circe/circe/blob/master/modules/core/shared/src/main/scala/io/circe/Json.scala#L517

So Json.fromDouble(Double.Nan) returns None - because Double.Nan is not real: https://github.com/circe/circe/blob/master/modules/core/shared/src/main/scala/io/circe/Json.scala#L575

Hence, in order to render Nan the way you want to, unfortunately, you will need to edit JSON string after rendering

As I understand you want a column that indicated whether "counter clockwise" exists in the string in the Comment column.

This would create a new logical column named key_word that indicates if the pattern is or not present in the string:

import org.apache.spark.sql.Row

In spark DataFrame, JSON objects read as Row objects, so you can access inner JSON just like below:

• inputRdd.forEach(i => i.getAs[Row](1))
• or inputRdd.forEach(i => i.getAs[Row]("params")).

(ps: i inside your code is actually also a Row object.)

Assuming that you are using the default one json serialisation library in akka-http - spray-json - you are quite restricted with combining several json readers (according to official page and source code). The best you can do is probably to write manually some formatter(or just reader) for Message.